3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12922 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.8 MiB / 342025
Shuffle Write Size / Records:
4.6 MiB / 488353
Associated Job Ids:
6359
DAG Visualization
digraph G { subgraph clusterstage_12922 { label="Stage 12922"; subgraph cluster83919 { label="AQEShuffleRead"; 35671 [labelType="html" label="ShuffledRowRDD [35671] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83916 { label="WholeStageCodegen (4)"; 35672 [labelType="html" label="MapPartitionsRDD [35672] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83915 { label="Window"; 35673 [labelType="html" label="MapPartitionsRDD [35673] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83909 { label="WholeStageCodegen (5)"; 35674 [labelType="html" label="MapPartitionsRDD [35674] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83923 { label="AQEShuffleRead"; 35675 [labelType="html" label="ShuffledRowRDD [35675] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83920 { label="WholeStageCodegen (6)"; 35676 [labelType="html" label="MapPartitionsRDD [35676] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83908 { label="Union"; 35677 [labelType="html" label="UnionRDD [35677] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83907 { label="Exchange"; 35681 [labelType="html" label="MapPartitionsRDD [35681] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35671->35672; 35672->35673; 35673->35674; 35675->35676; 35674->35677; 35676->35677; 35677->35681; }
35660,35671
35670,35675
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time