3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 22813 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
365.3 KiB / 21591
Shuffle Write Size / Records:
22.6 KiB / 1500
Associated Job Ids:
11299
DAG Visualization
digraph G { subgraph clusterstage_22813 { label="Stage 22813"; subgraph cluster147526 { label="AQEShuffleRead"; 64195 [labelType="html" label="ShuffledRowRDD [64195] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147523 { label="WholeStageCodegen (9)"; 64196 [labelType="html" label="MapPartitionsRDD [64196] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147533 { label="AQEShuffleRead"; 64197 [labelType="html" label="ShuffledRowRDD [64197] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147532 { label="ObjectHashAggregate"; 64198 [labelType="html" label="MapPartitionsRDD [64198] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147528 { label="WholeStageCodegen (10)"; 64199 [labelType="html" label="MapPartitionsRDD [64199] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147517 { label="WholeStageCodegen (11)"; 64200 [labelType="html" label="ZippedPartitionsRDD2 [64200] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64201 [labelType="html" label="MapPartitionsRDD [64201] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster147516 { label="Exchange"; 64202 [labelType="html" label="MapPartitionsRDD [64202] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64195->64196; 64197->64198; 64198->64199; 64196->64200; 64199->64200; 64200->64201; 64201->64202; }
64194,64195
64170,64197
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time