3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7781 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.0 s
Locality Level Summary:
Process local: 10
Input Size / Records:
4.2 MiB / 259495
Output Size / Records:
35.9 KiB / 41
Associated Job Ids:
3792
DAG Visualization
digraph G { subgraph clusterstage_7781 { label="Stage 7781"; subgraph cluster50356 { label="Scan parquet "; 22286 [labelType="html" label="FileScanRDD [22286]<br>parquet at PersistJob.java:35"]; 22287 [labelType="html" label="MapPartitionsRDD [22287]<br>parquet at PersistJob.java:35"]; } subgraph cluster50351 { label="WholeStageCodegen (1)"; 22288 [labelType="html" label="MapPartitionsRDD [22288]<br>parquet at PersistJob.java:35"]; } subgraph cluster50361 { label="Scan csv "; 22289 [labelType="html" label="FileScanRDD [22289]<br>parquet at PersistJob.java:35"]; 22290 [labelType="html" label="MapPartitionsRDD [22290]<br>parquet at PersistJob.java:35"]; } subgraph cluster50357 { label="WholeStageCodegen (2)"; 22291 [labelType="html" label="MapPartitionsRDD [22291]<br>parquet at PersistJob.java:35"]; } subgraph cluster50350 { label="CartesianProduct"; 22292 [labelType="html" label="UnsafeCartesianRDD [22292]<br>parquet at PersistJob.java:35"]; 22293 [labelType="html" label="MapPartitionsRDD [22293]<br>parquet at PersistJob.java:35"]; } subgraph cluster50346 { label="WholeStageCodegen (3)"; 22294 [labelType="html" label="MapPartitionsRDD [22294]<br>parquet at PersistJob.java:35"]; } subgraph cluster50345 { label="WriteFiles"; 22295 [labelType="html" label="MapPartitionsRDD [22295]<br>parquet at PersistJob.java:35"]; } } 22286->22287; 22287->22288; 22289->22290; 22290->22291; 22288->22292; 22291->22292; 22292->22293; 22293->22294; 22294->22295; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time