3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12835 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
762.3 KiB / 68658
Shuffle Write Size / Records:
1124.5 KiB / 64613
Associated Job Ids:
6304
DAG Visualization
digraph G { subgraph clusterstage_12835 { label="Stage 12835"; subgraph cluster83035 { label="AQEShuffleRead"; 35317 [labelType="html" label="ShuffledRowRDD [35317] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83032 { label="WholeStageCodegen (7)"; 35318 [labelType="html" label="MapPartitionsRDD [35318] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83040 { label="AQEShuffleRead"; 35319 [labelType="html" label="ShuffledRowRDD [35319] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83037 { label="WholeStageCodegen (8)"; 35320 [labelType="html" label="MapPartitionsRDD [35320] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83028 { label="WholeStageCodegen (9)"; 35321 [labelType="html" label="ZippedPartitionsRDD2 [35321] [Unordered]<br>parquet at PersistJob.java:35"]; 35322 [labelType="html" label="MapPartitionsRDD [35322] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83045 { label="AQEShuffleRead"; 35323 [labelType="html" label="ShuffledRowRDD [35323] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83042 { label="WholeStageCodegen (10)"; 35324 [labelType="html" label="MapPartitionsRDD [35324] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83024 { label="WholeStageCodegen (11)"; 35325 [labelType="html" label="ZippedPartitionsRDD2 [35325] [Unordered]<br>parquet at PersistJob.java:35"]; 35326 [labelType="html" label="MapPartitionsRDD [35326] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83023 { label="ObjectHashAggregate"; 35327 [labelType="html" label="MapPartitionsRDD [35327] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83022 { label="Exchange"; 35328 [labelType="html" label="MapPartitionsRDD [35328] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35317->35318; 35319->35320; 35318->35321; 35320->35321; 35321->35322; 35323->35324; 35322->35325; 35324->35325; 35325->35326; 35326->35327; 35327->35328; }
35301,35317
35305,35319
35309,35323
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time