3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 31352 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
28 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4045
Shuffle Write Size / Records:
142.0 B / 1
Associated Job Ids:
17242
DAG Visualization
digraph G { subgraph clusterstage_31352 { label="Stage 31352"; subgraph cluster200187 { label="AQEShuffleRead"; 86777 [labelType="html" label="ShuffledRowRDD [86777] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200184 { label="WholeStageCodegen (4)"; 86778 [labelType="html" label="MapPartitionsRDD [86778] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200192 { label="AQEShuffleRead"; 86779 [labelType="html" label="ShuffledRowRDD [86779] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200189 { label="WholeStageCodegen (5)"; 86780 [labelType="html" label="MapPartitionsRDD [86780] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200180 { label="WholeStageCodegen (6)"; 86781 [labelType="html" label="ZippedPartitionsRDD2 [86781] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 86782 [labelType="html" label="MapPartitionsRDD [86782] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200197 { label="AQEShuffleRead"; 86783 [labelType="html" label="ShuffledRowRDD [86783] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200194 { label="WholeStageCodegen (7)"; 86784 [labelType="html" label="MapPartitionsRDD [86784] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200176 { label="WholeStageCodegen (8)"; 86785 [labelType="html" label="ZippedPartitionsRDD2 [86785] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 86786 [labelType="html" label="MapPartitionsRDD [86786] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200175 { label="ObjectHashAggregate"; 86787 [labelType="html" label="MapPartitionsRDD [86787] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200174 { label="Exchange"; 86788 [labelType="html" label="MapPartitionsRDD [86788] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 86777->86778; 86779->86780; 86778->86781; 86780->86781; 86781->86782; 86783->86784; 86782->86785; 86784->86785; 86785->86786; 86786->86787; 86787->86788; }
86768,86777
86772,86779
86776,86783
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time