3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15098 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 2
Output Size / Records:
13.6 KiB / 145
Shuffle Read Size / Records:
2.5 MiB / 71527
Associated Job Ids:
7932
DAG Visualization
digraph G { subgraph clusterstage_15098 { label="Stage 15098"; subgraph cluster97024 { label="AQEShuffleRead"; 40939 [labelType="html" label="ShuffledRowRDD [40939] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97023 { label="ObjectHashAggregate"; 40940 [labelType="html" label="MapPartitionsRDD [40940] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97018 { label="WholeStageCodegen (10)"; 40941 [labelType="html" label="MapPartitionsRDD [40941] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97029 { label="AQEShuffleRead"; 40942 [labelType="html" label="ShuffledRowRDD [40942] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97026 { label="WholeStageCodegen (11)"; 40943 [labelType="html" label="MapPartitionsRDD [40943] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97008 { label="WholeStageCodegen (12)"; 40944 [labelType="html" label="ZippedPartitionsRDD2 [40944] [Unordered]<br>parquet at PersistJob.java:35"]; 40945 [labelType="html" label="MapPartitionsRDD [40945] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97007 { label="WriteFiles"; 40946 [labelType="html" label="MapPartitionsRDD [40946] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40939->40940; 40940->40941; 40942->40943; 40941->40944; 40943->40944; 40944->40945; 40945->40946; }
40936,40939
40926,40942
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time