3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12821 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
1952.7 KiB / 111848
Shuffle Write Size / Records:
1212.4 KiB / 38684
Associated Job Ids:
6298
DAG Visualization
digraph G { subgraph clusterstage_12821 { label="Stage 12821"; subgraph cluster82968 { label="AQEShuffleRead"; 35281 [labelType="html" label="ShuffledRowRDD [35281] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82965 { label="WholeStageCodegen (8)"; 35282 [labelType="html" label="MapPartitionsRDD [35282] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82973 { label="AQEShuffleRead"; 35283 [labelType="html" label="ShuffledRowRDD [35283] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82970 { label="WholeStageCodegen (9)"; 35284 [labelType="html" label="MapPartitionsRDD [35284] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82961 { label="WholeStageCodegen (10)"; 35285 [labelType="html" label="ZippedPartitionsRDD2 [35285] [Unordered]<br>parquet at PersistJob.java:35"]; 35286 [labelType="html" label="MapPartitionsRDD [35286] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster82960 { label="Exchange"; 35287 [labelType="html" label="MapPartitionsRDD [35287] [Unordered]<br>parquet at PersistJob.java:35"]; } } 35281->35282; 35283->35284; 35282->35285; 35284->35285; 35285->35286; 35286->35287; }
35272,35281
35255,35283
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time