3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12841 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 3
Output Size / Records:
20.9 KiB / 173
Shuffle Read Size / Records:
3.7 MiB / 103297
Associated Job Ids:
6305
DAG Visualization
digraph G { subgraph clusterstage_12841 { label="Stage 12841"; subgraph cluster83094 { label="AQEShuffleRead"; 35329 [labelType="html" label="ShuffledRowRDD [35329] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83091 { label="WholeStageCodegen (12)"; 35330 [labelType="html" label="MapPartitionsRDD [35330] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83100 { label="AQEShuffleRead"; 35331 [labelType="html" label="ShuffledRowRDD [35331] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83099 { label="ObjectHashAggregate"; 35332 [labelType="html" label="MapPartitionsRDD [35332] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83096 { label="WholeStageCodegen (13)"; 35333 [labelType="html" label="MapPartitionsRDD [35333] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83084 { label="WholeStageCodegen (14)"; 35334 [labelType="html" label="ZippedPartitionsRDD2 [35334] [Unordered]<br>parquet at PersistJob.java:35"]; 35335 [labelType="html" label="MapPartitionsRDD [35335] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster83083 { label="WriteFiles"; 35336 [labelType="html" label="MapPartitionsRDD [35336] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35329->35330; 35331->35332; 35332->35333; 35330->35334; 35333->35334; 35334->35335; 35335->35336; }
35297,35329
35328,35331
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time