3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 22697 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
422.2 KiB / 21566
Shuffle Write Size / Records:
356.2 KiB / 21127
Associated Job Ids:
11254
DAG Visualization
digraph G { subgraph clusterstage_22697 { label="Stage 22697"; subgraph cluster146988 { label="AQEShuffleRead"; 63954 [labelType="html" label="ShuffledRowRDD [63954] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146985 { label="WholeStageCodegen (6)"; 63955 [labelType="html" label="MapPartitionsRDD [63955] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146995 { label="AQEShuffleRead"; 63956 [labelType="html" label="ShuffledRowRDD [63956] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146994 { label="ObjectHashAggregate"; 63957 [labelType="html" label="MapPartitionsRDD [63957] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146990 { label="WholeStageCodegen (7)"; 63958 [labelType="html" label="MapPartitionsRDD [63958] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146981 { label="WholeStageCodegen (8)"; 63959 [labelType="html" label="ZippedPartitionsRDD2 [63959] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 63960 [labelType="html" label="MapPartitionsRDD [63960] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster146980 { label="Exchange"; 63961 [labelType="html" label="MapPartitionsRDD [63961] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 63954->63955; 63956->63957; 63957->63958; 63955->63959; 63958->63959; 63959->63960; 63960->63961; }
63933,63954
63938,63956
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time