3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8023 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
937.0 B / 7
Shuffle Write Size / Records:
1275.0 B / 7
Associated Job Ids:
3802
DAG Visualization
digraph G { subgraph clusterstage_8023 { label="Stage 8023"; subgraph cluster49525 { label="AQEShuffleRead"; 21381 [labelType="html" label="ShuffledRowRDD [21381] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49522 { label="WholeStageCodegen (36)"; 21382 [labelType="html" label="MapPartitionsRDD [21382] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49521 { label="Window"; 21383 [labelType="html" label="MapPartitionsRDD [21383] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49517 { label="WholeStageCodegen (37)"; 21384 [labelType="html" label="MapPartitionsRDD [21384] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49516 { label="Window"; 21385 [labelType="html" label="MapPartitionsRDD [21385] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49513 { label="WholeStageCodegen (38)"; 21386 [labelType="html" label="MapPartitionsRDD [21386] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49512 { label="Window"; 21387 [labelType="html" label="MapPartitionsRDD [21387] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49507 { label="WholeStageCodegen (39)"; 21388 [labelType="html" label="MapPartitionsRDD [21388] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49506 { label="Exchange"; 21389 [labelType="html" label="MapPartitionsRDD [21389] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21381->21382; 21382->21383; 21383->21384; 21384->21385; 21385->21386; 21386->21387; 21387->21388; 21388->21389; }
21380,21381
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time