3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6314 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.9 KiB / 533
Shuffle Write Size / Records:
4.2 KiB / 210
Associated Job Ids:
3347
DAG Visualization
digraph G { subgraph clusterstage_6314 { label="Stage 6314"; subgraph cluster42278 { label="AQEShuffleRead"; 18210 [labelType="html" label="ShuffledRowRDD [18210] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42274 { label="WholeStageCodegen (17)"; 18212 [labelType="html" label="MapPartitionsRDD [18212] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42290 { label="AQEShuffleRead"; 18213 [labelType="html" label="ShuffledRowRDD [18213] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42285 { label="WholeStageCodegen (18)"; 18214 [labelType="html" label="MapPartitionsRDD [18214] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42264 { label="WholeStageCodegen (19)"; 18215 [labelType="html" label="ZippedPartitionsRDD2 [18215] [Unordered]<br>count at ColumnStatJob.java:47"]; 18216 [labelType="html" label="MapPartitionsRDD [18216] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42300 { label="Scan csv "; 18220 [labelType="html" label="FileScanRDD [18220]<br>count at ColumnStatJob.java:47"]; 18221 [labelType="html" label="MapPartitionsRDD [18221]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42291 { label="WholeStageCodegen (20)"; 18222 [labelType="html" label="MapPartitionsRDD [18222]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42263 { label="CartesianProduct"; 18223 [labelType="html" label="UnsafeCartesianRDD [18223] [Unordered]<br>count at ColumnStatJob.java:47"]; 18224 [labelType="html" label="MapPartitionsRDD [18224] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42260 { label="WholeStageCodegen (21)"; 18225 [labelType="html" label="MapPartitionsRDD [18225] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42259 { label="Exchange"; 18226 [labelType="html" label="MapPartitionsRDD [18226] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 18210->18212; 18213->18214; 18212->18215; 18214->18215; 18215->18216; 18220->18221; 18221->18222; 18216->18223; 18222->18223; 18223->18224; 18224->18225; 18225->18226; }
18203,18210
18207,18213
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time