3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13370 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
8.5 MiB / 589932
Shuffle Write Size / Records:
8.2 MiB / 857416
Associated Job Ids:
5892
DAG Visualization
digraph G { subgraph clusterstage_13370 { label="Stage 13370"; subgraph cluster78305 { label="AQEShuffleRead"; 33121 [labelType="html" label="ShuffledRowRDD [33121] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78302 { label="WholeStageCodegen (4)"; 33122 [labelType="html" label="MapPartitionsRDD [33122] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78301 { label="Window"; 33123 [labelType="html" label="MapPartitionsRDD [33123] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78295 { label="WholeStageCodegen (5)"; 33124 [labelType="html" label="MapPartitionsRDD [33124] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78309 { label="AQEShuffleRead"; 33125 [labelType="html" label="ShuffledRowRDD [33125] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78306 { label="WholeStageCodegen (6)"; 33126 [labelType="html" label="MapPartitionsRDD [33126] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78294 { label="Union"; 33127 [labelType="html" label="UnionRDD [33127] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster78293 { label="Exchange"; 33131 [labelType="html" label="MapPartitionsRDD [33131] [Unordered]<br>parquet at PersistJob.java:35"]; } } 33121->33122; 33122->33123; 33123->33124; 33125->33126; 33124->33127; 33126->33127; 33127->33131; }
33110,33121
33120,33125
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time