3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15593 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Output Size / Records:
202.6 KiB / 36518
Shuffle Read Size / Records:
687.8 KiB / 36570
Associated Job Ids:
7687
DAG Visualization
digraph G { subgraph clusterstage_15593 { label="Stage 15593"; subgraph cluster100159 { label="AQEShuffleRead"; 42769 [labelType="html" label="ShuffledRowRDD [42769] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100156 { label="WholeStageCodegen (14)"; 42770 [labelType="html" label="MapPartitionsRDD [42770] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100164 { label="AQEShuffleRead"; 42771 [labelType="html" label="ShuffledRowRDD [42771] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100161 { label="WholeStageCodegen (15)"; 42772 [labelType="html" label="MapPartitionsRDD [42772] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100151 { label="WholeStageCodegen (16)"; 42773 [labelType="html" label="ZippedPartitionsRDD2 [42773] [Unordered]<br>parquet at PersistJob.java:35"]; 42774 [labelType="html" label="MapPartitionsRDD [42774] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100150 { label="WriteFiles"; 42775 [labelType="html" label="MapPartitionsRDD [42775] [Unordered]<br>parquet at PersistJob.java:35"]; } } 42769->42770; 42771->42772; 42770->42773; 42772->42773; 42773->42774; 42774->42775; }
42768,42769
42715,42771
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time