3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 22920 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
365.3 KiB / 21591
Shuffle Write Size / Records:
297.0 KiB / 21131
Associated Job Ids:
11341
DAG Visualization
digraph G { subgraph clusterstage_22920 { label="Stage 22920"; subgraph cluster148039 { label="AQEShuffleRead"; 64422 [labelType="html" label="ShuffledRowRDD [64422] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148036 { label="WholeStageCodegen (9)"; 64423 [labelType="html" label="MapPartitionsRDD [64423] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148046 { label="AQEShuffleRead"; 64424 [labelType="html" label="ShuffledRowRDD [64424] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148045 { label="ObjectHashAggregate"; 64425 [labelType="html" label="MapPartitionsRDD [64425] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148041 { label="WholeStageCodegen (10)"; 64426 [labelType="html" label="MapPartitionsRDD [64426] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148031 { label="WholeStageCodegen (11)"; 64427 [labelType="html" label="ZippedPartitionsRDD2 [64427] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64428 [labelType="html" label="MapPartitionsRDD [64428] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148030 { label="Exchange"; 64429 [labelType="html" label="MapPartitionsRDD [64429] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64422->64423; 64424->64425; 64425->64426; 64423->64427; 64426->64427; 64427->64428; 64428->64429; }
64418,64422
64397,64424
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time