3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12831 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Output Size / Records:
12.4 KiB / 321
Shuffle Read Size / Records:
1212.7 KiB / 38688
Associated Job Ids:
6303
DAG Visualization
digraph G { subgraph clusterstage_12831 { label="Stage 12831"; subgraph cluster83016 { label="AQEShuffleRead"; 35310 [labelType="html" label="ShuffledRowRDD [35310] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83013 { label="WholeStageCodegen (11)"; 35311 [labelType="html" label="MapPartitionsRDD [35311] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83021 { label="AQEShuffleRead"; 35312 [labelType="html" label="ShuffledRowRDD [35312] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83018 { label="WholeStageCodegen (12)"; 35313 [labelType="html" label="MapPartitionsRDD [35313] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83007 { label="WholeStageCodegen (13)"; 35314 [labelType="html" label="ZippedPartitionsRDD2 [35314] [Unordered]<br>parquet at PersistJob.java:35"]; 35315 [labelType="html" label="MapPartitionsRDD [35315] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83006 { label="WriteFiles"; 35316 [labelType="html" label="MapPartitionsRDD [35316] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35310->35311; 35312->35313; 35311->35314; 35313->35314; 35314->35315; 35315->35316; }
35287,35310
35259,35312
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time