3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14699 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
8 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
30.1 MiB / 598988
Shuffle Write Size / Records:
41.6 MiB / 598988
Associated Job Ids:
7826
DAG Visualization
digraph G { subgraph clusterstage_14699 { label="Stage 14699"; subgraph cluster95295 { label="AQEShuffleRead"; 40201 [labelType="html" label="ShuffledRowRDD [40201] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95292 { label="WholeStageCodegen (2)"; 40202 [labelType="html" label="MapPartitionsRDD [40202] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95291 { label="Window"; 40203 [labelType="html" label="MapPartitionsRDD [40203] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95287 { label="WholeStageCodegen (3)"; 40204 [labelType="html" label="MapPartitionsRDD [40204] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95286 { label="Window"; 40205 [labelType="html" label="MapPartitionsRDD [40205] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95283 { label="WholeStageCodegen (4)"; 40206 [labelType="html" label="MapPartitionsRDD [40206] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95282 { label="Exchange"; 40207 [labelType="html" label="MapPartitionsRDD [40207] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40201->40202; 40202->40203; 40203->40204; 40204->40205; 40205->40206; 40206->40207; }
40184,40201
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time