3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7767 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Output Size / Records:
30.6 KiB / 854
Shuffle Read Size / Records:
1747.8 KiB / 48489
Associated Job Ids:
3781
DAG Visualization
digraph G { subgraph clusterstage_7767 { label="Stage 7767"; subgraph cluster50159 { label="AQEShuffleRead"; 22190 [labelType="html" label="ShuffledRowRDD [22190] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50156 { label="WholeStageCodegen (11)"; 22191 [labelType="html" label="MapPartitionsRDD [22191] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50164 { label="AQEShuffleRead"; 22192 [labelType="html" label="ShuffledRowRDD [22192] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50161 { label="WholeStageCodegen (12)"; 22193 [labelType="html" label="MapPartitionsRDD [22193] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50150 { label="WholeStageCodegen (13)"; 22194 [labelType="html" label="ZippedPartitionsRDD2 [22194] [Unordered]<br>parquet at PersistJob.java:35"]; 22195 [labelType="html" label="MapPartitionsRDD [22195] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50149 { label="WriteFiles"; 22196 [labelType="html" label="MapPartitionsRDD [22196] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22190->22191; 22192->22193; 22191->22194; 22193->22194; 22194->22195; 22195->22196; }
22163,22190
22098,22192
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time