3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8333 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
1552.1 KiB / 110715
Associated Job Ids:
4121
DAG Visualization
digraph G { subgraph clusterstage_8333 { label="Stage 8333"; subgraph cluster54667 { label="AQEShuffleRead"; 24019 [labelType="html" label="ShuffledRowRDD [24019] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54664 { label="WholeStageCodegen (4)"; 24020 [labelType="html" label="MapPartitionsRDD [24020] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54663 { label="Window"; 24021 [labelType="html" label="MapPartitionsRDD [24021] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54657 { label="WholeStageCodegen (5)"; 24022 [labelType="html" label="MapPartitionsRDD [24022] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54671 { label="AQEShuffleRead"; 24023 [labelType="html" label="ShuffledRowRDD [24023] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54668 { label="WholeStageCodegen (6)"; 24024 [labelType="html" label="MapPartitionsRDD [24024] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54656 { label="Union"; 24025 [labelType="html" label="UnionRDD [24025] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster54655 { label="Exchange"; 24026 [labelType="html" label="MapPartitionsRDD [24026] [Unordered]<br>parquet at PersistJob.java:35"]; 24027 [labelType="html" label="MapPartitionsRDD [24027] [Unordered]<br>parquet at PersistJob.java:35"]; 24028 [labelType="html" label="MapPartitionsRDD [24028] [Unordered]<br>parquet at PersistJob.java:35"]; } } 24019->24020; 24020->24021; 24021->24022; 24023->24024; 24022->24025; 24024->24025; 24025->24026; 24026->24027; 24027->24028; }
24008,24019
24018,24023
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time