3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12822 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.1 MiB / 38694
Shuffle Write Size / Records:
2.6 MiB / 38684
Associated Job Ids:
6299
DAG Visualization
digraph G { subgraph clusterstage_12822 { label="Stage 12822"; subgraph cluster82980 { label="Scan parquet "; 35288 [labelType="html" label="FileScanRDD [35288]<br>parquet at PersistJob.java:35"]; 35289 [labelType="html" label="MapPartitionsRDD [35289]<br>parquet at PersistJob.java:35"]; } subgraph cluster82975 { label="WholeStageCodegen (1)"; 35290 [labelType="html" label="MapPartitionsRDD [35290]<br>parquet at PersistJob.java:35"]; } subgraph cluster82985 { label="Scan csv "; 35291 [labelType="html" label="FileScanRDD [35291]<br>parquet at PersistJob.java:35"]; 35292 [labelType="html" label="MapPartitionsRDD [35292]<br>parquet at PersistJob.java:35"]; } subgraph cluster82981 { label="WholeStageCodegen (2)"; 35293 [labelType="html" label="MapPartitionsRDD [35293]<br>parquet at PersistJob.java:35"]; } subgraph cluster82974 { label="CartesianProduct"; 35294 [labelType="html" label="UnsafeCartesianRDD [35294]<br>parquet at PersistJob.java:35"]; 35295 [labelType="html" label="MapPartitionsRDD [35295]<br>parquet at PersistJob.java:35"]; } subgraph cluster82952 { label="WholeStageCodegen (3)"; 35296 [labelType="html" label="MapPartitionsRDD [35296]<br>parquet at PersistJob.java:35"]; } subgraph cluster82951 { label="Exchange"; 35297 [labelType="html" label="MapPartitionsRDD [35297]<br>parquet at PersistJob.java:35"]; } } 35288->35289; 35289->35290; 35291->35292; 35292->35293; 35290->35294; 35293->35294; 35294->35295; 35295->35296; 35296->35297; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time