3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32314 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 7
Shuffle Read Size / Records:
18.1 MiB / 592158
Shuffle Write Size / Records:
16.5 MiB / 591883
Associated Job Ids:
17849
DAG Visualization
digraph G { subgraph clusterstage_32314 { label="Stage 32314"; subgraph cluster205903 { label="AQEShuffleRead"; 89146 [labelType="html" label="ShuffledRowRDD [89146] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205900 { label="WholeStageCodegen (38)"; 89147 [labelType="html" label="MapPartitionsRDD [89147] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205908 { label="AQEShuffleRead"; 89148 [labelType="html" label="ShuffledRowRDD [89148] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205905 { label="WholeStageCodegen (39)"; 89149 [labelType="html" label="MapPartitionsRDD [89149] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205896 { label="WholeStageCodegen (40)"; 89150 [labelType="html" label="ZippedPartitionsRDD2 [89150] [Unordered]<br>parquet at PersistJob.java:35"]; 89151 [labelType="html" label="MapPartitionsRDD [89151] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205913 { label="AQEShuffleRead"; 89152 [labelType="html" label="ShuffledRowRDD [89152] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205910 { label="WholeStageCodegen (41)"; 89153 [labelType="html" label="MapPartitionsRDD [89153] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205890 { label="WholeStageCodegen (42)"; 89154 [labelType="html" label="ZippedPartitionsRDD2 [89154] [Unordered]<br>parquet at PersistJob.java:35"]; 89155 [labelType="html" label="MapPartitionsRDD [89155] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205889 { label="Exchange"; 89156 [labelType="html" label="MapPartitionsRDD [89156] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89146->89147; 89148->89149; 89147->89150; 89149->89150; 89150->89151; 89152->89153; 89151->89154; 89153->89154; 89154->89155; 89155->89156; }
89145,89146
89068,89148
89072,89152
Event Timeline
Enable zooming
Tasks: 7. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time