3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32420 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
23.1 MiB / 474438
Shuffle Write Size / Records:
23.1 MiB / 474437
Associated Job Ids:
17868
DAG Visualization
digraph G { subgraph clusterstage_32420 { label="Stage 32420"; subgraph cluster206317 { label="AQEShuffleRead"; 89275 [labelType="html" label="ShuffledRowRDD [89275] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster206314 { label="WholeStageCodegen (3)"; 89276 [labelType="html" label="MapPartitionsRDD [89276] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster206322 { label="AQEShuffleRead"; 89277 [labelType="html" label="ShuffledRowRDD [89277] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster206319 { label="WholeStageCodegen (4)"; 89278 [labelType="html" label="MapPartitionsRDD [89278] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster206310 { label="WholeStageCodegen (5)"; 89279 [labelType="html" label="ZippedPartitionsRDD2 [89279] [Unordered]<br>parquet at PersistJob.java:35"]; 89280 [labelType="html" label="MapPartitionsRDD [89280] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster206309 { label="Exchange"; 89284 [labelType="html" label="MapPartitionsRDD [89284] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89275->89276; 89277->89278; 89276->89279; 89278->89279; 89279->89280; 89280->89284; }
89270,89275
89274,89277
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time