3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21138 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
781.7 KiB / 21566
Shuffle Write Size / Records:
647.4 KiB / 21127
Associated Job Ids:
10604
DAG Visualization
digraph G { subgraph clusterstage_21138 { label="Stage 21138"; subgraph cluster138640 { label="AQEShuffleRead"; 60125 [labelType="html" label="ShuffledRowRDD [60125] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138637 { label="WholeStageCodegen (5)"; 60126 [labelType="html" label="MapPartitionsRDD [60126] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138646 { label="AQEShuffleRead"; 60127 [labelType="html" label="ShuffledRowRDD [60127] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138645 { label="ObjectHashAggregate"; 60128 [labelType="html" label="MapPartitionsRDD [60128] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138642 { label="WholeStageCodegen (6)"; 60129 [labelType="html" label="MapPartitionsRDD [60129] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138633 { label="WholeStageCodegen (7)"; 60130 [labelType="html" label="ZippedPartitionsRDD2 [60130] [Unordered]<br>count at ColumnStatJob.java:47"]; 60131 [labelType="html" label="MapPartitionsRDD [60131] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138632 { label="Exchange"; 60132 [labelType="html" label="MapPartitionsRDD [60132] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 60125->60126; 60127->60128; 60128->60129; 60126->60130; 60129->60130; 60130->60131; 60131->60132; }
60110,60125
60115,60127
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time