3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16174 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.2 MiB / 284048
Shuffle Write Size / Records:
3.5 MiB / 375916
Associated Job Ids:
7912
DAG Visualization
digraph G { subgraph clusterstage_16174 { label="Stage 16174"; subgraph cluster103740 { label="AQEShuffleRead"; 44326 [labelType="html" label="ShuffledRowRDD [44326] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103737 { label="WholeStageCodegen (4)"; 44327 [labelType="html" label="MapPartitionsRDD [44327] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103736 { label="Window"; 44328 [labelType="html" label="MapPartitionsRDD [44328] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103730 { label="WholeStageCodegen (5)"; 44329 [labelType="html" label="MapPartitionsRDD [44329] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103744 { label="AQEShuffleRead"; 44330 [labelType="html" label="ShuffledRowRDD [44330] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103741 { label="WholeStageCodegen (6)"; 44331 [labelType="html" label="MapPartitionsRDD [44331] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103729 { label="Union"; 44332 [labelType="html" label="UnionRDD [44332] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103728 { label="Exchange"; 44336 [labelType="html" label="MapPartitionsRDD [44336] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44326->44327; 44327->44328; 44328->44329; 44330->44331; 44329->44332; 44331->44332; 44332->44336; }
44315,44326
44325,44330
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time