3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20927 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
781.7 KiB / 21566
Shuffle Write Size / Records:
667.4 KiB / 21127
Associated Job Ids:
10477
DAG Visualization
digraph G { subgraph clusterstage_20927 { label="Stage 20927"; subgraph cluster137316 { label="AQEShuffleRead"; 59539 [labelType="html" label="ShuffledRowRDD [59539] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137313 { label="WholeStageCodegen (5)"; 59540 [labelType="html" label="MapPartitionsRDD [59540] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137323 { label="AQEShuffleRead"; 59541 [labelType="html" label="ShuffledRowRDD [59541] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137322 { label="ObjectHashAggregate"; 59542 [labelType="html" label="MapPartitionsRDD [59542] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137318 { label="WholeStageCodegen (6)"; 59543 [labelType="html" label="MapPartitionsRDD [59543] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137309 { label="WholeStageCodegen (7)"; 59544 [labelType="html" label="ZippedPartitionsRDD2 [59544] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59545 [labelType="html" label="MapPartitionsRDD [59545] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137308 { label="Exchange"; 59546 [labelType="html" label="MapPartitionsRDD [59546] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59539->59540; 59541->59542; 59542->59543; 59540->59544; 59543->59544; 59544->59545; 59545->59546; }
59524,59539
59529,59541
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time