3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7789 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 12
Input Size / Records:
15.2 MiB / 1115968
Shuffle Write Size / Records:
23.1 MiB / 1115956
Associated Job Ids:
3799
DAG Visualization
digraph G { subgraph clusterstage_7789 { label="Stage 7789"; subgraph cluster50501 { label="Scan parquet "; 22350 [labelType="html" label="FileScanRDD [22350]<br>parquet at PersistJob.java:35"]; 22351 [labelType="html" label="MapPartitionsRDD [22351]<br>parquet at PersistJob.java:35"]; } subgraph cluster50497 { label="WholeStageCodegen (1)"; 22352 [labelType="html" label="MapPartitionsRDD [22352]<br>parquet at PersistJob.java:35"]; } subgraph cluster50520 { label="Scan csv "; 22355 [labelType="html" label="FileScanRDD [22355]<br>parquet at PersistJob.java:35"]; 22356 [labelType="html" label="MapPartitionsRDD [22356]<br>parquet at PersistJob.java:35"]; } subgraph cluster50516 { label="WholeStageCodegen (2)"; 22359 [labelType="html" label="MapPartitionsRDD [22359]<br>parquet at PersistJob.java:35"]; } subgraph cluster50496 { label="CartesianProduct"; 22360 [labelType="html" label="UnsafeCartesianRDD [22360]<br>parquet at PersistJob.java:35"]; 22362 [labelType="html" label="MapPartitionsRDD [22362]<br>parquet at PersistJob.java:35"]; } subgraph cluster50493 { label="WholeStageCodegen (3)"; 22366 [labelType="html" label="MapPartitionsRDD [22366]<br>parquet at PersistJob.java:35"]; } subgraph cluster50492 { label="Exchange"; 22368 [labelType="html" label="MapPartitionsRDD [22368]<br>parquet at PersistJob.java:35"]; } } 22350->22351; 22351->22352; 22355->22356; 22356->22359; 22352->22360; 22359->22360; 22360->22362; 22362->22366; 22366->22368; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time