3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7856 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Output Size / Records:
134.7 KiB / 3419
Shuffle Read Size / Records:
210.7 KiB / 3629
Associated Job Ids:
3841
DAG Visualization
digraph G { subgraph clusterstage_7856 { label="Stage 7856"; subgraph cluster51293 { label="AQEShuffleRead"; 22689 [labelType="html" label="ShuffledRowRDD [22689] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51290 { label="WholeStageCodegen (22)"; 22690 [labelType="html" label="MapPartitionsRDD [22690] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51298 { label="AQEShuffleRead"; 22691 [labelType="html" label="ShuffledRowRDD [22691] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51295 { label="WholeStageCodegen (23)"; 22692 [labelType="html" label="MapPartitionsRDD [22692] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51285 { label="WholeStageCodegen (24)"; 22693 [labelType="html" label="ZippedPartitionsRDD2 [22693] [Unordered]<br>parquet at PersistJob.java:35"]; 22694 [labelType="html" label="MapPartitionsRDD [22694] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51284 { label="WriteFiles"; 22695 [labelType="html" label="MapPartitionsRDD [22695] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22689->22690; 22691->22692; 22690->22693; 22692->22693; 22693->22694; 22694->22695; }
22660,22689
22688,22691
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time