3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16904 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 10
Output Size / Records:
91.3 KiB / 441
Shuffle Read Size / Records:
12.8 MiB / 475582
Associated Job Ids:
8217
DAG Visualization
digraph G { subgraph clusterstage_16904 { label="Stage 16904"; subgraph cluster107889 { label="Exchange"; 46099 [labelType="html" label="ShuffledRowRDD [46099] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107887 { label="ObjectHashAggregate"; 46100 [labelType="html" label="MapPartitionsRDD [46100] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107884 { label="WholeStageCodegen (5)"; 46101 [labelType="html" label="MapPartitionsRDD [46101] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107895 { label="Exchange"; 46102 [labelType="html" label="ShuffledRowRDD [46102] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107891 { label="WholeStageCodegen (6)"; 46103 [labelType="html" label="MapPartitionsRDD [46103] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107857 { label="WholeStageCodegen (7)"; 46104 [labelType="html" label="ZippedPartitionsRDD2 [46104] [Unordered]<br>parquet at PersistJob.java:35"]; 46105 [labelType="html" label="MapPartitionsRDD [46105] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107856 { label="WriteFiles"; 46106 [labelType="html" label="MapPartitionsRDD [46106] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46099->46100; 46100->46101; 46102->46103; 46101->46104; 46103->46104; 46104->46105; 46105->46106; }
46017,46099
46021,46102
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time