3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20840 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
292.0 KiB / 42253
Shuffle Write Size / Records:
102.0 B / 1
Associated Job Ids:
10434
DAG Visualization
digraph G { subgraph clusterstage_20840 { label="Stage 20840"; subgraph cluster136726 { label="AQEShuffleRead"; 59245 [labelType="html" label="ShuffledRowRDD [59245] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136723 { label="WholeStageCodegen (11)"; 59246 [labelType="html" label="MapPartitionsRDD [59246] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136732 { label="AQEShuffleRead"; 59247 [labelType="html" label="ShuffledRowRDD [59247] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136728 { label="WholeStageCodegen (12)"; 59248 [labelType="html" label="MapPartitionsRDD [59248] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136719 { label="WholeStageCodegen (13)"; 59249 [labelType="html" label="ZippedPartitionsRDD2 [59249] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59250 [labelType="html" label="MapPartitionsRDD [59250] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136718 { label="SortAggregate"; 59251 [labelType="html" label="MapPartitionsRDD [59251] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136717 { label="Exchange"; 59252 [labelType="html" label="MapPartitionsRDD [59252] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59245->59246; 59247->59248; 59246->59249; 59248->59249; 59249->59250; 59250->59251; 59251->59252; }
59244,59245
59220,59247
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time