3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13366 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
8.5 MiB / 589932
Associated Job Ids:
5891
DAG Visualization
digraph G { subgraph clusterstage_13366 { label="Stage 13366"; subgraph cluster78305 { label="AQEShuffleRead"; 33121 [labelType="html" label="ShuffledRowRDD [33121] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78302 { label="WholeStageCodegen (4)"; 33122 [labelType="html" label="MapPartitionsRDD [33122] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78301 { label="Window"; 33123 [labelType="html" label="MapPartitionsRDD [33123] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78295 { label="WholeStageCodegen (5)"; 33124 [labelType="html" label="MapPartitionsRDD [33124] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78309 { label="AQEShuffleRead"; 33125 [labelType="html" label="ShuffledRowRDD [33125] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78306 { label="WholeStageCodegen (6)"; 33126 [labelType="html" label="MapPartitionsRDD [33126] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78294 { label="Union"; 33127 [labelType="html" label="UnionRDD [33127] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78293 { label="Exchange"; 33128 [labelType="html" label="MapPartitionsRDD [33128] [Unordered]<br>parquet at PersistJob.java:35"]; 33129 [labelType="html" label="MapPartitionsRDD [33129] [Unordered]<br>parquet at PersistJob.java:35"]; 33130 [labelType="html" label="MapPartitionsRDD [33130] [Unordered]<br>parquet at PersistJob.java:35"]; } } 33121->33122; 33122->33123; 33123->33124; 33125->33126; 33124->33127; 33126->33127; 33127->33128; 33128->33129; 33129->33130; }
33110,33121
33120,33125
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time