3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6327 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
6.0 MiB / 98481
Shuffle Write Size / Records:
115.0 B / 2
Associated Job Ids:
3354
DAG Visualization
digraph G { subgraph clusterstage_6327 { label="Stage 6327"; subgraph cluster42420 { label="AQEShuffleRead"; 18287 [labelType="html" label="ShuffledRowRDD [18287] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42417 { label="WholeStageCodegen (22)"; 18288 [labelType="html" label="MapPartitionsRDD [18288] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42429 { label="AQEShuffleRead"; 18290 [labelType="html" label="ShuffledRowRDD [18290] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42424 { label="WholeStageCodegen (23)"; 18292 [labelType="html" label="MapPartitionsRDD [18292] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42408 { label="WholeStageCodegen (24)"; 18293 [labelType="html" label="ZippedPartitionsRDD2 [18293] [Unordered]<br>count at ColumnStatJob.java:47"]; 18294 [labelType="html" label="MapPartitionsRDD [18294] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42407 { label="Exchange"; 18295 [labelType="html" label="MapPartitionsRDD [18295] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 18287->18288; 18290->18292; 18288->18293; 18292->18293; 18293->18294; 18294->18295; }
18192,18287
18226,18290
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time