3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21038 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
81 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
676.5 KiB / 21591
Shuffle Write Size / Records:
51.5 KiB / 1500
Associated Job Ids:
10523
DAG Visualization
digraph G { subgraph clusterstage_21038 { label="Stage 21038"; subgraph cluster137971 { label="AQEShuffleRead"; 59859 [labelType="html" label="ShuffledRowRDD [59859] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137968 { label="WholeStageCodegen (8)"; 59860 [labelType="html" label="MapPartitionsRDD [59860] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137978 { label="AQEShuffleRead"; 59861 [labelType="html" label="ShuffledRowRDD [59861] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137977 { label="ObjectHashAggregate"; 59862 [labelType="html" label="MapPartitionsRDD [59862] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137973 { label="WholeStageCodegen (9)"; 59863 [labelType="html" label="MapPartitionsRDD [59863] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137963 { label="WholeStageCodegen (10)"; 59864 [labelType="html" label="ZippedPartitionsRDD2 [59864] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59865 [labelType="html" label="MapPartitionsRDD [59865] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137962 { label="Exchange"; 59866 [labelType="html" label="MapPartitionsRDD [59866] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59859->59860; 59861->59862; 59862->59863; 59860->59864; 59863->59864; 59864->59865; 59865->59866; }
59858,59859
59846,59861
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time