3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16928 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Output Size / Records:
30.6 KiB / 852
Shuffle Read Size / Records:
1740.4 KiB / 48283
Associated Job Ids:
8231
DAG Visualization
digraph G { subgraph clusterstage_16928 { label="Stage 16928"; subgraph cluster108109 { label="AQEShuffleRead"; 46211 [labelType="html" label="ShuffledRowRDD [46211] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108106 { label="WholeStageCodegen (11)"; 46217 [labelType="html" label="MapPartitionsRDD [46217] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108114 { label="AQEShuffleRead"; 46218 [labelType="html" label="ShuffledRowRDD [46218] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108111 { label="WholeStageCodegen (12)"; 46219 [labelType="html" label="MapPartitionsRDD [46219] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108081 { label="WholeStageCodegen (13)"; 46220 [labelType="html" label="ZippedPartitionsRDD2 [46220] [Unordered]<br>parquet at PersistJob.java:35"]; 46221 [labelType="html" label="MapPartitionsRDD [46221] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108080 { label="WriteFiles"; 46222 [labelType="html" label="MapPartitionsRDD [46222] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46211->46217; 46218->46219; 46217->46220; 46219->46220; 46220->46221; 46221->46222; }
46179,46211
46098,46218
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time