3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7817 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1052.8 KiB / 79704
Shuffle Write Size / Records:
1449.0 KiB / 74906
Associated Job Ids:
3815
DAG Visualization
digraph G { subgraph clusterstage_7817 { label="Stage 7817"; subgraph cluster50818 { label="AQEShuffleRead"; 22476 [labelType="html" label="ShuffledRowRDD [22476] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50815 { label="WholeStageCodegen (7)"; 22477 [labelType="html" label="MapPartitionsRDD [22477] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50823 { label="AQEShuffleRead"; 22478 [labelType="html" label="ShuffledRowRDD [22478] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50820 { label="WholeStageCodegen (8)"; 22479 [labelType="html" label="MapPartitionsRDD [22479] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50811 { label="WholeStageCodegen (9)"; 22480 [labelType="html" label="ZippedPartitionsRDD2 [22480] [Unordered]<br>parquet at PersistJob.java:35"]; 22481 [labelType="html" label="MapPartitionsRDD [22481] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50828 { label="AQEShuffleRead"; 22482 [labelType="html" label="ShuffledRowRDD [22482] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50825 { label="WholeStageCodegen (10)"; 22483 [labelType="html" label="MapPartitionsRDD [22483] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50807 { label="WholeStageCodegen (11)"; 22484 [labelType="html" label="ZippedPartitionsRDD2 [22484] [Unordered]<br>parquet at PersistJob.java:35"]; 22485 [labelType="html" label="MapPartitionsRDD [22485] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50806 { label="ObjectHashAggregate"; 22486 [labelType="html" label="MapPartitionsRDD [22486] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50805 { label="Exchange"; 22487 [labelType="html" label="MapPartitionsRDD [22487] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22476->22477; 22478->22479; 22477->22480; 22479->22480; 22480->22481; 22482->22483; 22481->22484; 22483->22484; 22484->22485; 22485->22486; 22486->22487; }
22467,22476
22471,22478
22475,22482
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time