3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15247 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
961.0 KiB / 6263
Shuffle Write Size / Records:
482.7 KiB / 6253
Associated Job Ids:
7706
DAG Visualization
digraph G { subgraph clusterstage_15247 { label="Stage 15247"; subgraph cluster99190 { label="Scan parquet "; 42162 [labelType="html" label="FileScanRDD [42162]<br>count at ColumnStatJob.java:47"]; 42163 [labelType="html" label="MapPartitionsRDD [42163]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99185 { label="WholeStageCodegen (1)"; 42164 [labelType="html" label="MapPartitionsRDD [42164]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99195 { label="Scan csv "; 42165 [labelType="html" label="FileScanRDD [42165]<br>count at ColumnStatJob.java:47"]; 42166 [labelType="html" label="MapPartitionsRDD [42166]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99191 { label="WholeStageCodegen (2)"; 42167 [labelType="html" label="MapPartitionsRDD [42167]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99184 { label="CartesianProduct"; 42168 [labelType="html" label="UnsafeCartesianRDD [42168]<br>count at ColumnStatJob.java:47"]; 42169 [labelType="html" label="MapPartitionsRDD [42169]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99176 { label="WholeStageCodegen (3)"; 42170 [labelType="html" label="MapPartitionsRDD [42170]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99175 { label="Exchange"; 42171 [labelType="html" label="MapPartitionsRDD [42171]<br>count at ColumnStatJob.java:47"]; } } 42162->42163; 42163->42164; 42165->42166; 42166->42167; 42164->42168; 42167->42168; 42168->42169; 42169->42170; 42170->42171; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time