3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32669 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Output Size / Records:
4.5 MiB / 126243
Shuffle Read Size / Records:
6.2 MiB / 126410
Associated Job Ids:
18001
DAG Visualization
digraph G { subgraph clusterstage_32669 { label="Stage 32669"; subgraph cluster208597 { label="AQEShuffleRead"; 90288 [labelType="html" label="ShuffledRowRDD [90288] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208594 { label="WholeStageCodegen (20)"; 90289 [labelType="html" label="MapPartitionsRDD [90289] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208602 { label="AQEShuffleRead"; 90290 [labelType="html" label="ShuffledRowRDD [90290] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208599 { label="WholeStageCodegen (21)"; 90291 [labelType="html" label="MapPartitionsRDD [90291] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208590 { label="WholeStageCodegen (22)"; 90292 [labelType="html" label="ZippedPartitionsRDD2 [90292] [Unordered]<br>parquet at PersistJob.java:35"]; 90293 [labelType="html" label="MapPartitionsRDD [90293] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208589 { label="WriteFiles"; 90294 [labelType="html" label="MapPartitionsRDD [90294] [Unordered]<br>parquet at PersistJob.java:35"]; } } 90288->90289; 90290->90291; 90289->90292; 90291->90292; 90292->90293; 90293->90294; }
90265,90288
90287,90290
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time