3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15266 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.2 MiB / 285629
Associated Job Ids:
8044
DAG Visualization
digraph G { subgraph clusterstage_15266 { label="Stage 15266"; subgraph cluster98748 { label="AQEShuffleRead"; 41715 [labelType="html" label="ShuffledRowRDD [41715] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98745 { label="WholeStageCodegen (4)"; 41716 [labelType="html" label="MapPartitionsRDD [41716] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98744 { label="Window"; 41717 [labelType="html" label="MapPartitionsRDD [41717] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98738 { label="WholeStageCodegen (5)"; 41718 [labelType="html" label="MapPartitionsRDD [41718] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98752 { label="AQEShuffleRead"; 41719 [labelType="html" label="ShuffledRowRDD [41719] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98749 { label="WholeStageCodegen (6)"; 41720 [labelType="html" label="MapPartitionsRDD [41720] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98737 { label="Union"; 41721 [labelType="html" label="UnionRDD [41721] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98736 { label="Exchange"; 41722 [labelType="html" label="MapPartitionsRDD [41722] [Unordered]<br>parquet at PersistJob.java:35"]; 41723 [labelType="html" label="MapPartitionsRDD [41723] [Unordered]<br>parquet at PersistJob.java:35"]; 41724 [labelType="html" label="MapPartitionsRDD [41724] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41715->41716; 41716->41717; 41717->41718; 41719->41720; 41718->41721; 41720->41721; 41721->41722; 41722->41723; 41723->41724; }
41704,41715
41714,41719
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time