3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8391 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
178.3 KiB / 884780
Shuffle Write Size / Records:
144.0 B / 5
Associated Job Ids:
4158
DAG Visualization
digraph G { subgraph clusterstage_8391 { label="Stage 8391"; subgraph cluster55008 { label="AQEShuffleRead"; 24159 [labelType="html" label="ShuffledRowRDD [24159] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55005 { label="WholeStageCodegen (3)"; 24160 [labelType="html" label="MapPartitionsRDD [24160] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55013 { label="AQEShuffleRead"; 24161 [labelType="html" label="ShuffledRowRDD [24161] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55010 { label="WholeStageCodegen (4)"; 24162 [labelType="html" label="MapPartitionsRDD [24162] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55000 { label="WholeStageCodegen (5)"; 24163 [labelType="html" label="ZippedPartitionsRDD2 [24163] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24164 [labelType="html" label="MapPartitionsRDD [24164] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster54999 { label="Exchange"; 24165 [labelType="html" label="MapPartitionsRDD [24165] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24159->24160; 24161->24162; 24160->24163; 24162->24163; 24163->24164; 24164->24165; }
24154,24159
24158,24161
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time