3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15270 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
58 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
113.1 KiB / 6443
Associated Job Ids:
7718
DAG Visualization
digraph G { subgraph clusterstage_15270 { label="Stage 15270"; subgraph cluster99333 { label="AQEShuffleRead"; 42240 [labelType="html" label="ShuffledRowRDD [42240] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99330 { label="WholeStageCodegen (7)"; 42241 [labelType="html" label="MapPartitionsRDD [42241] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99338 { label="AQEShuffleRead"; 42242 [labelType="html" label="ShuffledRowRDD [42242] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99335 { label="WholeStageCodegen (8)"; 42243 [labelType="html" label="MapPartitionsRDD [42243] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99326 { label="WholeStageCodegen (9)"; 42244 [labelType="html" label="ZippedPartitionsRDD2 [42244] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42245 [labelType="html" label="MapPartitionsRDD [42245] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99343 { label="AQEShuffleRead"; 42246 [labelType="html" label="ShuffledRowRDD [42246] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99340 { label="WholeStageCodegen (10)"; 42247 [labelType="html" label="MapPartitionsRDD [42247] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99322 { label="WholeStageCodegen (11)"; 42248 [labelType="html" label="ZippedPartitionsRDD2 [42248] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42249 [labelType="html" label="MapPartitionsRDD [42249] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99321 { label="ObjectHashAggregate"; 42250 [labelType="html" label="MapPartitionsRDD [42250] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99320 { label="Exchange"; 42251 [labelType="html" label="MapPartitionsRDD [42251] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42240->42241; 42242->42243; 42241->42244; 42243->42244; 42244->42245; 42246->42247; 42245->42248; 42247->42248; 42248->42249; 42249->42250; 42250->42251; }
42231,42240
42235,42242
42239,42246
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time