3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17420 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
847.8 KiB / 2231124
Shuffle Write Size / Records:
96.0 B / 1
Associated Job Ids:
9247
DAG Visualization
digraph G { subgraph clusterstage_17420 { label="Stage 17420"; subgraph cluster113439 { label="AQEShuffleRead"; 48240 [labelType="html" label="ShuffledRowRDD [48240] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113436 { label="WholeStageCodegen (3)"; 48241 [labelType="html" label="MapPartitionsRDD [48241] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113444 { label="AQEShuffleRead"; 48242 [labelType="html" label="ShuffledRowRDD [48242] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113441 { label="WholeStageCodegen (4)"; 48243 [labelType="html" label="MapPartitionsRDD [48243] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113432 { label="WholeStageCodegen (5)"; 48244 [labelType="html" label="ZippedPartitionsRDD2 [48244] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48245 [labelType="html" label="MapPartitionsRDD [48245] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113431 { label="SortAggregate"; 48246 [labelType="html" label="MapPartitionsRDD [48246] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113430 { label="Exchange"; 48247 [labelType="html" label="MapPartitionsRDD [48247] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48240->48241; 48242->48243; 48241->48244; 48243->48244; 48244->48245; 48245->48246; 48246->48247; }
48235,48240
48239,48242
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time