3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8081 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
31 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
252.0 B / 7
Associated Job Ids:
3824
DAG Visualization
digraph G { subgraph clusterstage_8081 { label="Stage 8081"; subgraph cluster49939 { label="Scan parquet "; 21524 [labelType="html" label="FileScanRDD [21524]<br>count at ColumnStatJob.java:47"]; 21525 [labelType="html" label="MapPartitionsRDD [21525]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49934 { label="WholeStageCodegen (1)"; 21526 [labelType="html" label="MapPartitionsRDD [21526]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49946 { label="Scan csv "; 21528 [labelType="html" label="FileScanRDD [21528]<br>count at ColumnStatJob.java:47"]; 21529 [labelType="html" label="MapPartitionsRDD [21529]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49942 { label="WholeStageCodegen (2)"; 21530 [labelType="html" label="MapPartitionsRDD [21530]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49933 { label="CartesianProduct"; 21531 [labelType="html" label="UnsafeCartesianRDD [21531]<br>count at ColumnStatJob.java:47"]; 21532 [labelType="html" label="MapPartitionsRDD [21532]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49930 { label="WholeStageCodegen (3)"; 21533 [labelType="html" label="MapPartitionsRDD [21533]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49929 { label="Exchange"; 21534 [labelType="html" label="MapPartitionsRDD [21534]<br>count at ColumnStatJob.java:47"]; } } 21524->21525; 21525->21526; 21528->21529; 21529->21530; 21526->21531; 21530->21531; 21531->21532; 21532->21533; 21533->21534; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time