3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44954 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4046
Shuffle Write Size / Records:
140.0 B / 1
Associated Job Ids:
23855
DAG Visualization
digraph G { subgraph clusterstage_44954 { label="Stage 44954"; subgraph cluster310192 { label="AQEShuffleRead"; 135840 [labelType="html" label="ShuffledRowRDD [135840] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310189 { label="WholeStageCodegen (4)"; 135841 [labelType="html" label="MapPartitionsRDD [135841] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310197 { label="AQEShuffleRead"; 135842 [labelType="html" label="ShuffledRowRDD [135842] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310194 { label="WholeStageCodegen (5)"; 135843 [labelType="html" label="MapPartitionsRDD [135843] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310185 { label="WholeStageCodegen (6)"; 135844 [labelType="html" label="ZippedPartitionsRDD2 [135844] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 135845 [labelType="html" label="MapPartitionsRDD [135845] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310202 { label="AQEShuffleRead"; 135846 [labelType="html" label="ShuffledRowRDD [135846] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310199 { label="WholeStageCodegen (7)"; 135847 [labelType="html" label="MapPartitionsRDD [135847] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310181 { label="WholeStageCodegen (8)"; 135848 [labelType="html" label="ZippedPartitionsRDD2 [135848] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 135849 [labelType="html" label="MapPartitionsRDD [135849] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310180 { label="ObjectHashAggregate"; 135850 [labelType="html" label="MapPartitionsRDD [135850] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310179 { label="Exchange"; 135851 [labelType="html" label="MapPartitionsRDD [135851] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 135840->135841; 135842->135843; 135841->135844; 135843->135844; 135844->135845; 135846->135847; 135845->135848; 135847->135848; 135848->135849; 135849->135850; 135850->135851; }
135831,135840
135835,135842
135839,135846
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time