3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15169 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Output Size / Records:
37.9 KiB / 1174
Shuffle Read Size / Records:
1068.2 KiB / 34263
Associated Job Ids:
7982
DAG Visualization
digraph G { subgraph clusterstage_15169 { label="Stage 15169"; subgraph cluster97705 { label="AQEShuffleRead"; 41300 [labelType="html" label="ShuffledRowRDD [41300] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97702 { label="WholeStageCodegen (11)"; 41301 [labelType="html" label="MapPartitionsRDD [41301] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97710 { label="AQEShuffleRead"; 41302 [labelType="html" label="ShuffledRowRDD [41302] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97707 { label="WholeStageCodegen (12)"; 41303 [labelType="html" label="MapPartitionsRDD [41303] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97696 { label="WholeStageCodegen (13)"; 41304 [labelType="html" label="ZippedPartitionsRDD2 [41304] [Unordered]<br>parquet at PersistJob.java:35"]; 41305 [labelType="html" label="MapPartitionsRDD [41305] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97695 { label="WriteFiles"; 41306 [labelType="html" label="MapPartitionsRDD [41306] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41300->41301; 41302->41303; 41301->41304; 41303->41304; 41304->41305; 41305->41306; }
41297,41300
41279,41302
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time