3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 42918 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
76 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1435.2 KiB / 21631
Shuffle Write Size / Records:
1435.6 KiB / 21421
Associated Job Ids:
22520
DAG Visualization
digraph G { subgraph clusterstage_42918 { label="Stage 42918"; subgraph cluster294896 { label="AQEShuffleRead"; 129280 [labelType="html" label="ShuffledRowRDD [129280] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294893 { label="WholeStageCodegen (27)"; 129281 [labelType="html" label="MapPartitionsRDD [129281] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294901 { label="AQEShuffleRead"; 129282 [labelType="html" label="ShuffledRowRDD [129282] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294898 { label="WholeStageCodegen (28)"; 129283 [labelType="html" label="MapPartitionsRDD [129283] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294889 { label="WholeStageCodegen (29)"; 129284 [labelType="html" label="ZippedPartitionsRDD2 [129284] [Unordered]<br>parquet at PersistJob.java:35"]; 129285 [labelType="html" label="MapPartitionsRDD [129285] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294888 { label="Exchange"; 129286 [labelType="html" label="MapPartitionsRDD [129286] [Unordered]<br>parquet at PersistJob.java:35"]; } } 129280->129281; 129282->129283; 129281->129284; 129283->129284; 129284->129285; 129285->129286; }
129257,129280
129279,129282
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time