3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32353 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2.6 min
Locality Level Summary:
Any: 10
Output Size / Records:
12.4 MiB / 591883
Shuffle Read Size / Records:
22.7 MiB / 591883
Associated Job Ids:
17851
DAG Visualization
digraph G { subgraph clusterstage_32353 { label="Stage 32353"; subgraph cluster205975 { label="Exchange"; 89168 [labelType="html" label="ShuffledRowRDD [89168] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205971 { label="WholeStageCodegen (48)"; 89169 [labelType="html" label="MapPartitionsRDD [89169] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205970 { label="Window"; 89170 [labelType="html" label="MapPartitionsRDD [89170] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205966 { label="WholeStageCodegen (49)"; 89171 [labelType="html" label="MapPartitionsRDD [89171] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205965 { label="Window"; 89172 [labelType="html" label="MapPartitionsRDD [89172] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205962 { label="WholeStageCodegen (50)"; 89173 [labelType="html" label="MapPartitionsRDD [89173] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205961 { label="Window"; 89174 [labelType="html" label="MapPartitionsRDD [89174] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205955 { label="WholeStageCodegen (51)"; 89175 [labelType="html" label="MapPartitionsRDD [89175] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205954 { label="Window"; 89176 [labelType="html" label="MapPartitionsRDD [89176] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205950 { label="WholeStageCodegen (52)"; 89177 [labelType="html" label="MapPartitionsRDD [89177] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205949 { label="Window"; 89178 [labelType="html" label="MapPartitionsRDD [89178] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205945 { label="WholeStageCodegen (53)"; 89179 [labelType="html" label="MapPartitionsRDD [89179] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205944 { label="Window"; 89180 [labelType="html" label="MapPartitionsRDD [89180] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205941 { label="WholeStageCodegen (54)"; 89181 [labelType="html" label="MapPartitionsRDD [89181] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster205940 { label="WriteFiles"; 89182 [labelType="html" label="MapPartitionsRDD [89182] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89168->89169; 89169->89170; 89170->89171; 89171->89172; 89172->89173; 89173->89174; 89174->89175; 89175->89176; 89176->89177; 89177->89178; 89178->89179; 89179->89180; 89180->89181; 89181->89182; }
89167,89168
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time