3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21167 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
781.7 KiB / 21566
Shuffle Write Size / Records:
667.4 KiB / 21127
Associated Job Ids:
10614
DAG Visualization
digraph G { subgraph clusterstage_21167 { label="Stage 21167"; subgraph cluster138788 { label="AQEShuffleRead"; 60189 [labelType="html" label="ShuffledRowRDD [60189] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138785 { label="WholeStageCodegen (5)"; 60190 [labelType="html" label="MapPartitionsRDD [60190] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138795 { label="AQEShuffleRead"; 60191 [labelType="html" label="ShuffledRowRDD [60191] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138794 { label="ObjectHashAggregate"; 60192 [labelType="html" label="MapPartitionsRDD [60192] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138790 { label="WholeStageCodegen (6)"; 60193 [labelType="html" label="MapPartitionsRDD [60193] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138781 { label="WholeStageCodegen (7)"; 60194 [labelType="html" label="ZippedPartitionsRDD2 [60194] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 60195 [labelType="html" label="MapPartitionsRDD [60195] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138780 { label="Exchange"; 60196 [labelType="html" label="MapPartitionsRDD [60196] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 60189->60190; 60191->60192; 60192->60193; 60190->60194; 60193->60194; 60194->60195; 60195->60196; }
60174,60189
60179,60191
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time