3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6310 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
3345
DAG Visualization
digraph G { subgraph clusterstage_6310 { label="Stage 6310"; subgraph cluster42230 { label="Scan parquet "; 18193 [labelType="html" label="FileScanRDD [18193]<br>count at ColumnStatJob.java:47"]; 18194 [labelType="html" label="MapPartitionsRDD [18194]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42225 { label="WholeStageCodegen (13)"; 18195 [labelType="html" label="MapPartitionsRDD [18195]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42236 { label="Scan parquet "; 18196 [labelType="html" label="FileScanRDD [18196]<br>count at ColumnStatJob.java:47"]; 18197 [labelType="html" label="MapPartitionsRDD [18197]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42231 { label="WholeStageCodegen (14)"; 18198 [labelType="html" label="MapPartitionsRDD [18198]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42242 { label="Scan parquet "; 18199 [labelType="html" label="FileScanRDD [18199]<br>count at ColumnStatJob.java:47"]; 18200 [labelType="html" label="MapPartitionsRDD [18200]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42237 { label="WholeStageCodegen (15)"; 18201 [labelType="html" label="MapPartitionsRDD [18201]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42224 { label="Union"; 18202 [labelType="html" label="UnionRDD [18202]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42223 { label="Exchange"; 18203 [labelType="html" label="MapPartitionsRDD [18203]<br>count at ColumnStatJob.java:47"]; } } 18193->18194; 18194->18195; 18196->18197; 18197->18198; 18199->18200; 18200->18201; 18195->18202; 18198->18202; 18201->18202; 18202->18203; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time