3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16628 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
47 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
89.4 MiB / 1116233
Shuffle Write Size / Records:
65.7 MiB / 1115956
Associated Job Ids:
8110
DAG Visualization
digraph G { subgraph clusterstage_16628 { label="Stage 16628"; subgraph cluster106173 { label="AQEShuffleRead"; 45344 [labelType="html" label="ShuffledRowRDD [45344] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106170 { label="WholeStageCodegen (35)"; 45345 [labelType="html" label="MapPartitionsRDD [45345] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106178 { label="AQEShuffleRead"; 45346 [labelType="html" label="ShuffledRowRDD [45346] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106175 { label="WholeStageCodegen (36)"; 45347 [labelType="html" label="MapPartitionsRDD [45347] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106166 { label="WholeStageCodegen (37)"; 45348 [labelType="html" label="ZippedPartitionsRDD2 [45348] [Unordered]<br>parquet at PersistJob.java:35"]; 45349 [labelType="html" label="MapPartitionsRDD [45349] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106183 { label="AQEShuffleRead"; 45350 [labelType="html" label="ShuffledRowRDD [45350] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106180 { label="WholeStageCodegen (38)"; 45351 [labelType="html" label="MapPartitionsRDD [45351] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106162 { label="WholeStageCodegen (39)"; 45352 [labelType="html" label="ZippedPartitionsRDD2 [45352] [Unordered]<br>parquet at PersistJob.java:35"]; 45353 [labelType="html" label="MapPartitionsRDD [45353] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106188 { label="AQEShuffleRead"; 45354 [labelType="html" label="ShuffledRowRDD [45354] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106185 { label="WholeStageCodegen (40)"; 45355 [labelType="html" label="MapPartitionsRDD [45355] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106158 { label="WholeStageCodegen (41)"; 45356 [labelType="html" label="ZippedPartitionsRDD2 [45356] [Unordered]<br>parquet at PersistJob.java:35"]; 45357 [labelType="html" label="MapPartitionsRDD [45357] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106157 { label="Exchange"; 45358 [labelType="html" label="MapPartitionsRDD [45358] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45344->45345; 45346->45347; 45345->45348; 45347->45348; 45348->45349; 45350->45351; 45349->45352; 45351->45352; 45352->45353; 45354->45355; 45353->45356; 45355->45356; 45356->45357; 45357->45358; }
45343,45344
45273,45346
45277,45350
45281,45354
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time