3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8000 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
30 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
98.2 MiB / 2132018
Shuffle Read Size / Records:
11.4 MiB / 262408
Associated Job Ids:
3900
DAG Visualization
digraph G { subgraph clusterstage_8000 { label="Stage 8000"; subgraph cluster52253 { label="Exchange"; 23054 [labelType="html" label="ShuffledRowRDD [23054] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52249 { label="WholeStageCodegen (18)"; 23055 [labelType="html" label="MapPartitionsRDD [23055] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52248 { label="Window"; 23056 [labelType="html" label="MapPartitionsRDD [23056] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52246 { label="Filter"; 23057 [labelType="html" label="MapPartitionsRDD [23057] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52245 { label="Project"; 23058 [labelType="html" label="MapPartitionsRDD [23058] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52244 { label="Project"; 23059 [labelType="html" label="MapPartitionsRDD [23059] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52243 { label="Project"; 23060 [labelType="html" label="MapPartitionsRDD [23060] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52242 { label="Project"; 23061 [labelType="html" label="MapPartitionsRDD [23061] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52241 { label="Project"; 23062 [labelType="html" label="MapPartitionsRDD [23062] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52259 { label="Scan parquet "; 23063 [labelType="html" label="FileScanRDD [23063]<br>parquet at PersistJob.java:35"]; 23064 [labelType="html" label="MapPartitionsRDD [23064]<br>parquet at PersistJob.java:35"]; } subgraph cluster52254 { label="WholeStageCodegen (20)"; 23065 [labelType="html" label="MapPartitionsRDD [23065]<br>parquet at PersistJob.java:35"]; } subgraph cluster52232 { label="Union"; 23066 [labelType="html" label="UnionRDD [23066] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster52231 { label="Exchange"; 23067 [labelType="html" label="MapPartitionsRDD [23067] [Unordered]<br>parquet at PersistJob.java:35"]; 23068 [labelType="html" label="MapPartitionsRDD [23068] [Unordered]<br>parquet at PersistJob.java:35"]; 23069 [labelType="html" label="MapPartitionsRDD [23069] [Unordered]<br>parquet at PersistJob.java:35"]; } } 23054->23055; 23055->23056; 23056->23057; 23057->23058; 23058->23059; 23059->23060; 23060->23061; 23061->23062; 23063->23064; 23064->23065; 23062->23066; 23065->23066; 23066->23067; 23067->23068; 23068->23069; }
23053,23054
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time