3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15123 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 2
Output Size / Records:
13.2 KiB / 124
Shuffle Read Size / Records:
2.7 MiB / 255443
Associated Job Ids:
7955
DAG Visualization
digraph G { subgraph clusterstage_15123 { label="Stage 15123"; subgraph cluster97347 { label="AQEShuffleRead"; 41108 [labelType="html" label="ShuffledRowRDD [41108] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97344 { label="WholeStageCodegen (5)"; 41109 [labelType="html" label="MapPartitionsRDD [41109] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97343 { label="Window"; 41110 [labelType="html" label="MapPartitionsRDD [41110] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97339 { label="WholeStageCodegen (6)"; 41111 [labelType="html" label="MapPartitionsRDD [41111] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97352 { label="AQEShuffleRead"; 41112 [labelType="html" label="ShuffledRowRDD [41112] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97349 { label="WholeStageCodegen (7)"; 41113 [labelType="html" label="MapPartitionsRDD [41113] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97334 { label="WholeStageCodegen (8)"; 41114 [labelType="html" label="ZippedPartitionsRDD2 [41114] [Unordered]<br>parquet at PersistJob.java:35"]; 41115 [labelType="html" label="MapPartitionsRDD [41115] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97333 { label="Window"; 41116 [labelType="html" label="MapPartitionsRDD [41116] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97321 { label="WholeStageCodegen (9)"; 41117 [labelType="html" label="MapPartitionsRDD [41117] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97320 { label="WriteFiles"; 41118 [labelType="html" label="MapPartitionsRDD [41118] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41108->41109; 41109->41110; 41110->41111; 41112->41113; 41111->41114; 41113->41114; 41114->41115; 41115->41116; 41116->41117; 41117->41118; }
41103,41108
41107,41112
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time