3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16085 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 2
Output Size / Records:
227.9 KiB / 4997
Shuffle Read Size / Records:
3.1 MiB / 77064
Associated Job Ids:
7855
DAG Visualization
digraph G { subgraph clusterstage_16085 { label="Stage 16085"; subgraph cluster102814 { label="AQEShuffleRead"; 43946 [labelType="html" label="ShuffledRowRDD [43946] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102811 { label="WholeStageCodegen (12)"; 43947 [labelType="html" label="MapPartitionsRDD [43947] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102820 { label="AQEShuffleRead"; 43948 [labelType="html" label="ShuffledRowRDD [43948] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102819 { label="ObjectHashAggregate"; 43949 [labelType="html" label="MapPartitionsRDD [43949] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102816 { label="WholeStageCodegen (13)"; 43950 [labelType="html" label="MapPartitionsRDD [43950] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102804 { label="WholeStageCodegen (14)"; 43951 [labelType="html" label="ZippedPartitionsRDD2 [43951] [Unordered]<br>parquet at PersistJob.java:35"]; 43952 [labelType="html" label="MapPartitionsRDD [43952] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102803 { label="WriteFiles"; 43953 [labelType="html" label="MapPartitionsRDD [43953] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43946->43947; 43948->43949; 43949->43950; 43947->43951; 43950->43951; 43951->43952; 43952->43953; }
43897,43946
43934,43948
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time