3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32127 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
16 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
62.3 MiB / 1500475
Shuffle Write Size / Records:
86.5 MiB / 1500475
Spill (Memory):
704.0 MiB
Spill (Disk):
4.7 MiB
Associated Job Ids:
17806
DAG Visualization
digraph G { subgraph clusterstage_32127 { label="Stage 32127"; subgraph cluster205293 { label="AQEShuffleRead"; 88867 [labelType="html" label="ShuffledRowRDD [88867] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205290 { label="WholeStageCodegen (2)"; 88868 [labelType="html" label="MapPartitionsRDD [88868] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205289 { label="Window"; 88869 [labelType="html" label="MapPartitionsRDD [88869] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205285 { label="WholeStageCodegen (3)"; 88870 [labelType="html" label="MapPartitionsRDD [88870] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205284 { label="Window"; 88871 [labelType="html" label="MapPartitionsRDD [88871] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205281 { label="WholeStageCodegen (4)"; 88872 [labelType="html" label="MapPartitionsRDD [88872] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205280 { label="Exchange"; 88873 [labelType="html" label="MapPartitionsRDD [88873] [Unordered]<br>parquet at PersistJob.java:35"]; } } 88867->88868; 88868->88869; 88869->88870; 88870->88871; 88871->88872; 88872->88873; }
88850,88867
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time