3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 22808 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
422.2 KiB / 21566
Shuffle Write Size / Records:
356.2 KiB / 21127
Associated Job Ids:
11298
DAG Visualization
digraph G { subgraph clusterstage_22808 { label="Stage 22808"; subgraph cluster147508 { label="AQEShuffleRead"; 64187 [labelType="html" label="ShuffledRowRDD [64187] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147505 { label="WholeStageCodegen (6)"; 64188 [labelType="html" label="MapPartitionsRDD [64188] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147515 { label="AQEShuffleRead"; 64189 [labelType="html" label="ShuffledRowRDD [64189] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147514 { label="ObjectHashAggregate"; 64190 [labelType="html" label="MapPartitionsRDD [64190] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147510 { label="WholeStageCodegen (7)"; 64191 [labelType="html" label="MapPartitionsRDD [64191] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147501 { label="WholeStageCodegen (8)"; 64192 [labelType="html" label="ZippedPartitionsRDD2 [64192] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64193 [labelType="html" label="MapPartitionsRDD [64193] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147500 { label="Exchange"; 64194 [labelType="html" label="MapPartitionsRDD [64194] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64187->64188; 64189->64190; 64190->64191; 64188->64192; 64191->64192; 64192->64193; 64193->64194; }
64160,64187
64165,64189
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time