3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32531 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
5.9 MiB / 596805
Shuffle Write Size / Records:
5.0 MiB / 87514
Associated Job Ids:
17919
DAG Visualization
digraph G { subgraph clusterstage_32531 { label="Stage 32531"; subgraph cluster207155 { label="AQEShuffleRead"; 89671 [labelType="html" label="ShuffledRowRDD [89671] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207152 { label="WholeStageCodegen (7)"; 89672 [labelType="html" label="MapPartitionsRDD [89672] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207160 { label="AQEShuffleRead"; 89673 [labelType="html" label="ShuffledRowRDD [89673] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207157 { label="WholeStageCodegen (8)"; 89674 [labelType="html" label="MapPartitionsRDD [89674] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207148 { label="WholeStageCodegen (9)"; 89675 [labelType="html" label="ZippedPartitionsRDD2 [89675] [Unordered]<br>parquet at PersistJob.java:35"]; 89676 [labelType="html" label="MapPartitionsRDD [89676] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207147 { label="ObjectHashAggregate"; 89677 [labelType="html" label="MapPartitionsRDD [89677] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207146 { label="Exchange"; 89678 [labelType="html" label="MapPartitionsRDD [89678] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89671->89672; 89673->89674; 89672->89675; 89674->89675; 89675->89676; 89676->89677; 89677->89678; }
89660,89671
89664,89673
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time