3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17045 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.8 MiB / 414221
Associated Job Ids:
8308
DAG Visualization
digraph G { subgraph clusterstage_17045 { label="Stage 17045"; subgraph cluster109332 { label="AQEShuffleRead"; 46742 [labelType="html" label="ShuffledRowRDD [46742] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109329 { label="WholeStageCodegen (4)"; 46743 [labelType="html" label="MapPartitionsRDD [46743] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109328 { label="Window"; 46744 [labelType="html" label="MapPartitionsRDD [46744] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109322 { label="WholeStageCodegen (5)"; 46745 [labelType="html" label="MapPartitionsRDD [46745] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109336 { label="AQEShuffleRead"; 46746 [labelType="html" label="ShuffledRowRDD [46746] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109333 { label="WholeStageCodegen (6)"; 46747 [labelType="html" label="MapPartitionsRDD [46747] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109321 { label="Union"; 46748 [labelType="html" label="UnionRDD [46748] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109320 { label="Exchange"; 46749 [labelType="html" label="MapPartitionsRDD [46749] [Unordered]<br>parquet at PersistJob.java:35"]; 46750 [labelType="html" label="MapPartitionsRDD [46750] [Unordered]<br>parquet at PersistJob.java:35"]; 46751 [labelType="html" label="MapPartitionsRDD [46751] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46742->46743; 46743->46744; 46744->46745; 46746->46747; 46745->46748; 46747->46748; 46748->46749; 46749->46750; 46750->46751; }
46731,46742
46741,46746
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time