3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32538 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 5
Output Size / Records:
881.8 KiB / 21411
Shuffle Read Size / Records:
6.2 MiB / 136129
Associated Job Ids:
17922
DAG Visualization
digraph G { subgraph clusterstage_32538 { label="Stage 32538"; subgraph cluster207195 { label="AQEShuffleRead"; 89689 [labelType="html" label="ShuffledRowRDD [89689] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207194 { label="ObjectHashAggregate"; 89690 [labelType="html" label="MapPartitionsRDD [89690] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207189 { label="WholeStageCodegen (10)"; 89692 [labelType="html" label="MapPartitionsRDD [89692] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207203 { label="AQEShuffleRead"; 89693 [labelType="html" label="ShuffledRowRDD [89693] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207200 { label="WholeStageCodegen (11)"; 89694 [labelType="html" label="MapPartitionsRDD [89694] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207173 { label="WholeStageCodegen (12)"; 89696 [labelType="html" label="ZippedPartitionsRDD2 [89696] [Unordered]<br>parquet at PersistJob.java:35"]; 89701 [labelType="html" label="MapPartitionsRDD [89701] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207172 { label="WriteFiles"; 89702 [labelType="html" label="MapPartitionsRDD [89702] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89689->89690; 89690->89692; 89693->89694; 89692->89696; 89694->89696; 89696->89701; 89701->89702; }
89678,89689
89668,89693
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time