3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 4268 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4046
Shuffle Write Size / Records:
136.0 B / 1
Associated Job Ids:
2229
DAG Visualization
digraph G { subgraph clusterstage_4268 { label="Stage 4268"; subgraph cluster27951 { label="AQEShuffleRead"; 12123 [labelType="html" label="ShuffledRowRDD [12123] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27948 { label="WholeStageCodegen (4)"; 12124 [labelType="html" label="MapPartitionsRDD [12124] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27956 { label="AQEShuffleRead"; 12125 [labelType="html" label="ShuffledRowRDD [12125] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27953 { label="WholeStageCodegen (5)"; 12126 [labelType="html" label="MapPartitionsRDD [12126] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27944 { label="WholeStageCodegen (6)"; 12127 [labelType="html" label="ZippedPartitionsRDD2 [12127] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 12128 [labelType="html" label="MapPartitionsRDD [12128] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27961 { label="AQEShuffleRead"; 12129 [labelType="html" label="ShuffledRowRDD [12129] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27958 { label="WholeStageCodegen (7)"; 12130 [labelType="html" label="MapPartitionsRDD [12130] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27940 { label="WholeStageCodegen (8)"; 12131 [labelType="html" label="ZippedPartitionsRDD2 [12131] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 12132 [labelType="html" label="MapPartitionsRDD [12132] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27939 { label="ObjectHashAggregate"; 12133 [labelType="html" label="MapPartitionsRDD [12133] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster27938 { label="Exchange"; 12134 [labelType="html" label="MapPartitionsRDD [12134] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 12123->12124; 12125->12126; 12124->12127; 12126->12127; 12127->12128; 12129->12130; 12128->12131; 12130->12131; 12131->12132; 12132->12133; 12133->12134; }
12114,12123
12118,12125
12122,12129
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time