3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32333 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
14 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
16.5 MiB / 591908
Shuffle Write Size / Records:
22.7 MiB / 591883
Associated Job Ids:
17850
DAG Visualization
digraph G { subgraph clusterstage_32333 { label="Stage 32333"; subgraph cluster205929 { label="AQEShuffleRead"; 89157 [labelType="html" label="ShuffledRowRDD [89157] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205926 { label="WholeStageCodegen (43)"; 89158 [labelType="html" label="MapPartitionsRDD [89158] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205934 { label="AQEShuffleRead"; 89159 [labelType="html" label="ShuffledRowRDD [89159] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205931 { label="WholeStageCodegen (44)"; 89160 [labelType="html" label="MapPartitionsRDD [89160] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205920 { label="WholeStageCodegen (45)"; 89161 [labelType="html" label="ZippedPartitionsRDD2 [89161] [Unordered]<br>parquet at PersistJob.java:35"]; 89162 [labelType="html" label="MapPartitionsRDD [89162] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205939 { label="AQEShuffleRead"; 89163 [labelType="html" label="ShuffledRowRDD [89163] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205936 { label="WholeStageCodegen (46)"; 89164 [labelType="html" label="MapPartitionsRDD [89164] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205915 { label="WholeStageCodegen (47)"; 89165 [labelType="html" label="ZippedPartitionsRDD2 [89165] [Unordered]<br>parquet at PersistJob.java:35"]; 89166 [labelType="html" label="MapPartitionsRDD [89166] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205914 { label="Exchange"; 89167 [labelType="html" label="MapPartitionsRDD [89167] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89157->89158; 89159->89160; 89158->89161; 89160->89161; 89161->89162; 89163->89164; 89162->89165; 89164->89165; 89165->89166; 89166->89167; }
89156,89157
89080,89159
89084,89163
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time