3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18002 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
137.8 KiB / 682827
Shuffle Write Size / Records:
144.0 B / 5
Associated Job Ids:
8901
DAG Visualization
digraph G { subgraph clusterstage_18002 { label="Stage 18002"; subgraph cluster115543 { label="AQEShuffleRead"; 49167 [labelType="html" label="ShuffledRowRDD [49167] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster115540 { label="WholeStageCodegen (3)"; 49168 [labelType="html" label="MapPartitionsRDD [49168] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster115548 { label="AQEShuffleRead"; 49169 [labelType="html" label="ShuffledRowRDD [49169] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster115545 { label="WholeStageCodegen (4)"; 49170 [labelType="html" label="MapPartitionsRDD [49170] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster115535 { label="WholeStageCodegen (5)"; 49171 [labelType="html" label="ZippedPartitionsRDD2 [49171] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 49172 [labelType="html" label="MapPartitionsRDD [49172] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster115534 { label="Exchange"; 49173 [labelType="html" label="MapPartitionsRDD [49173] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 49167->49168; 49169->49170; 49168->49171; 49170->49171; 49171->49172; 49172->49173; }
49162,49167
49166,49169
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time