3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16035 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1689.4 KiB / 79969
Shuffle Write Size / Records:
1057.8 KiB / 34035
Associated Job Ids:
7824
DAG Visualization
digraph G { subgraph clusterstage_16035 { label="Stage 16035"; subgraph cluster102315 { label="AQEShuffleRead"; 43715 [labelType="html" label="ShuffledRowRDD [43715] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102312 { label="WholeStageCodegen (8)"; 43716 [labelType="html" label="MapPartitionsRDD [43716] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102320 { label="AQEShuffleRead"; 43717 [labelType="html" label="ShuffledRowRDD [43717] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102317 { label="WholeStageCodegen (9)"; 43718 [labelType="html" label="MapPartitionsRDD [43718] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102308 { label="WholeStageCodegen (10)"; 43719 [labelType="html" label="ZippedPartitionsRDD2 [43719] [Unordered]<br>parquet at PersistJob.java:35"]; 43720 [labelType="html" label="MapPartitionsRDD [43720] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102307 { label="Exchange"; 43721 [labelType="html" label="MapPartitionsRDD [43721] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43715->43716; 43717->43718; 43716->43719; 43718->43719; 43719->43720; 43720->43721; }
43714,43715
43697,43717
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time