3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15153 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 2
Output Size / Records:
37.9 KiB / 1119
Shuffle Read Size / Records:
2.2 MiB / 117461
Associated Job Ids:
7975
DAG Visualization
digraph G { subgraph clusterstage_15153 { label="Stage 15153"; subgraph cluster97606 { label="AQEShuffleRead"; 41245 [labelType="html" label="ShuffledRowRDD [41245] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97603 { label="WholeStageCodegen (8)"; 41246 [labelType="html" label="MapPartitionsRDD [41246] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97611 { label="AQEShuffleRead"; 41248 [labelType="html" label="ShuffledRowRDD [41248] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97608 { label="WholeStageCodegen (9)"; 41250 [labelType="html" label="MapPartitionsRDD [41250] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97599 { label="WholeStageCodegen (10)"; 41251 [labelType="html" label="ZippedPartitionsRDD2 [41251] [Unordered]<br>parquet at PersistJob.java:35"]; 41252 [labelType="html" label="MapPartitionsRDD [41252] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97617 { label="AQEShuffleRead"; 41253 [labelType="html" label="ShuffledRowRDD [41253] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97616 { label="ObjectHashAggregate"; 41254 [labelType="html" label="MapPartitionsRDD [41254] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97613 { label="WholeStageCodegen (11)"; 41255 [labelType="html" label="MapPartitionsRDD [41255] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97576 { label="WholeStageCodegen (12)"; 41256 [labelType="html" label="ZippedPartitionsRDD2 [41256] [Unordered]<br>parquet at PersistJob.java:35"]; 41257 [labelType="html" label="MapPartitionsRDD [41257] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97575 { label="WriteFiles"; 41258 [labelType="html" label="MapPartitionsRDD [41258] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41245->41246; 41248->41250; 41246->41251; 41250->41251; 41251->41252; 41253->41254; 41254->41255; 41252->41256; 41255->41256; 41256->41257; 41257->41258; }
41224,41245
41198,41248
41203,41253
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time