3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7436 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1338.7 KiB / 259486
Shuffle Write Size / Records:
1143.9 KiB / 48482
Associated Job Ids:
3665
DAG Visualization
digraph G { subgraph clusterstage_7436 { label="Stage 7436"; subgraph cluster48388 { label="AQEShuffleRead"; 21380 [labelType="html" label="ShuffledRowRDD [21380] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48385 { label="WholeStageCodegen (18)"; 21381 [labelType="html" label="MapPartitionsRDD [21381] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48393 { label="AQEShuffleRead"; 21382 [labelType="html" label="ShuffledRowRDD [21382] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48390 { label="WholeStageCodegen (19)"; 21383 [labelType="html" label="MapPartitionsRDD [21383] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48380 { label="WholeStageCodegen (20)"; 21384 [labelType="html" label="ZippedPartitionsRDD2 [21384] [Unordered]<br>parquet at PersistJob.java:35"]; 21385 [labelType="html" label="MapPartitionsRDD [21385] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48379 { label="Exchange"; 21386 [labelType="html" label="MapPartitionsRDD [21386] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21380->21381; 21382->21383; 21381->21384; 21383->21384; 21384->21385; 21385->21386; }
21379,21380
21337,21382
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time