3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15178 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.1 MiB / 34269
Shuffle Write Size / Records:
2.4 MiB / 34259
Associated Job Ids:
7988
DAG Visualization
digraph G { subgraph clusterstage_15178 { label="Stage 15178"; subgraph cluster97884 { label="Scan parquet "; 41351 [labelType="html" label="FileScanRDD [41351]<br>parquet at PersistJob.java:35"]; 41352 [labelType="html" label="MapPartitionsRDD [41352]<br>parquet at PersistJob.java:35"]; } subgraph cluster97879 { label="WholeStageCodegen (1)"; 41353 [labelType="html" label="MapPartitionsRDD [41353]<br>parquet at PersistJob.java:35"]; } subgraph cluster97889 { label="Scan csv "; 41354 [labelType="html" label="FileScanRDD [41354]<br>parquet at PersistJob.java:35"]; 41355 [labelType="html" label="MapPartitionsRDD [41355]<br>parquet at PersistJob.java:35"]; } subgraph cluster97885 { label="WholeStageCodegen (2)"; 41356 [labelType="html" label="MapPartitionsRDD [41356]<br>parquet at PersistJob.java:35"]; } subgraph cluster97878 { label="CartesianProduct"; 41357 [labelType="html" label="UnsafeCartesianRDD [41357]<br>parquet at PersistJob.java:35"]; 41358 [labelType="html" label="MapPartitionsRDD [41358]<br>parquet at PersistJob.java:35"]; } subgraph cluster97870 { label="WholeStageCodegen (3)"; 41359 [labelType="html" label="MapPartitionsRDD [41359]<br>parquet at PersistJob.java:35"]; } subgraph cluster97869 { label="Exchange"; 41360 [labelType="html" label="MapPartitionsRDD [41360]<br>parquet at PersistJob.java:35"]; } } 41351->41352; 41352->41353; 41354->41355; 41355->41356; 41353->41357; 41356->41357; 41357->41358; 41358->41359; 41359->41360; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time