3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16605 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
32 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4045
Shuffle Write Size / Records:
135.0 B / 1
Associated Job Ids:
8705
DAG Visualization
digraph G { subgraph clusterstage_16605 { label="Stage 16605"; subgraph cluster107193 { label="AQEShuffleRead"; 45251 [labelType="html" label="ShuffledRowRDD [45251] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107190 { label="WholeStageCodegen (4)"; 45252 [labelType="html" label="MapPartitionsRDD [45252] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107198 { label="AQEShuffleRead"; 45253 [labelType="html" label="ShuffledRowRDD [45253] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107195 { label="WholeStageCodegen (5)"; 45254 [labelType="html" label="MapPartitionsRDD [45254] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107186 { label="WholeStageCodegen (6)"; 45255 [labelType="html" label="ZippedPartitionsRDD2 [45255] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 45256 [labelType="html" label="MapPartitionsRDD [45256] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107203 { label="AQEShuffleRead"; 45257 [labelType="html" label="ShuffledRowRDD [45257] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107200 { label="WholeStageCodegen (7)"; 45258 [labelType="html" label="MapPartitionsRDD [45258] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107182 { label="WholeStageCodegen (8)"; 45259 [labelType="html" label="ZippedPartitionsRDD2 [45259] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 45260 [labelType="html" label="MapPartitionsRDD [45260] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107181 { label="ObjectHashAggregate"; 45261 [labelType="html" label="MapPartitionsRDD [45261] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107180 { label="Exchange"; 45262 [labelType="html" label="MapPartitionsRDD [45262] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 45251->45252; 45253->45254; 45252->45255; 45254->45255; 45255->45256; 45257->45258; 45256->45259; 45258->45259; 45259->45260; 45260->45261; 45261->45262; }
45242,45251
45246,45253
45250,45257
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time