3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 42830 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
940.7 KiB / 21017
Shuffle Write Size / Records:
945.3 KiB / 20807
Associated Job Ids:
22471
DAG Visualization
digraph G { subgraph clusterstage_42830 { label="Stage 42830"; subgraph cluster294029 { label="AQEShuffleRead"; 128956 [labelType="html" label="ShuffledRowRDD [128956] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294026 { label="WholeStageCodegen (62)"; 128957 [labelType="html" label="MapPartitionsRDD [128957] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294034 { label="AQEShuffleRead"; 128958 [labelType="html" label="ShuffledRowRDD [128958] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294031 { label="WholeStageCodegen (63)"; 128959 [labelType="html" label="MapPartitionsRDD [128959] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294022 { label="WholeStageCodegen (64)"; 128960 [labelType="html" label="ZippedPartitionsRDD2 [128960] [Unordered]<br>parquet at PersistJob.java:35"]; 128961 [labelType="html" label="MapPartitionsRDD [128961] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster294021 { label="Exchange"; 128962 [labelType="html" label="MapPartitionsRDD [128962] [Unordered]<br>parquet at PersistJob.java:35"]; } } 128956->128957; 128958->128959; 128957->128960; 128959->128960; 128960->128961; 128961->128962; }
128955,128956
128913,128958
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time