3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16010 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 2
Output Size / Records:
13.5 KiB / 144
Shuffle Read Size / Records:
2.5 MiB / 71303
Associated Job Ids:
7807
DAG Visualization
digraph G { subgraph clusterstage_16010 { label="Stage 16010"; subgraph cluster102093 { label="AQEShuffleRead"; 43607 [labelType="html" label="ShuffledRowRDD [43607] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102092 { label="ObjectHashAggregate"; 43608 [labelType="html" label="MapPartitionsRDD [43608] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102087 { label="WholeStageCodegen (10)"; 43609 [labelType="html" label="MapPartitionsRDD [43609] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102098 { label="AQEShuffleRead"; 43610 [labelType="html" label="ShuffledRowRDD [43610] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102095 { label="WholeStageCodegen (11)"; 43611 [labelType="html" label="MapPartitionsRDD [43611] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102079 { label="WholeStageCodegen (12)"; 43612 [labelType="html" label="ZippedPartitionsRDD2 [43612] [Unordered]<br>parquet at PersistJob.java:35"]; 43613 [labelType="html" label="MapPartitionsRDD [43613] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102078 { label="WriteFiles"; 43614 [labelType="html" label="MapPartitionsRDD [43614] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43607->43608; 43608->43609; 43610->43611; 43609->43612; 43611->43612; 43612->43613; 43613->43614; }
43594,43607
43586,43610
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time