3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15119 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1355.2 KiB / 85900
Shuffle Write Size / Records:
1606.6 KiB / 85895
Associated Job Ids:
7953
DAG Visualization
digraph G { subgraph clusterstage_15119 { label="Stage 15119"; subgraph cluster97307 { label="Scan parquet "; 41094 [labelType="html" label="FileScanRDD [41094]<br>parquet at PersistJob.java:35"]; 41095 [labelType="html" label="MapPartitionsRDD [41095]<br>parquet at PersistJob.java:35"]; } subgraph cluster97303 { label="WholeStageCodegen (1)"; 41096 [labelType="html" label="MapPartitionsRDD [41096]<br>parquet at PersistJob.java:35"]; } subgraph cluster97312 { label="Scan csv "; 41097 [labelType="html" label="FileScanRDD [41097]<br>parquet at PersistJob.java:35"]; 41098 [labelType="html" label="MapPartitionsRDD [41098]<br>parquet at PersistJob.java:35"]; } subgraph cluster97308 { label="WholeStageCodegen (2)"; 41099 [labelType="html" label="MapPartitionsRDD [41099]<br>parquet at PersistJob.java:35"]; } subgraph cluster97302 { label="CartesianProduct"; 41100 [labelType="html" label="UnsafeCartesianRDD [41100]<br>parquet at PersistJob.java:35"]; 41101 [labelType="html" label="MapPartitionsRDD [41101]<br>parquet at PersistJob.java:35"]; } subgraph cluster97299 { label="WholeStageCodegen (3)"; 41102 [labelType="html" label="MapPartitionsRDD [41102]<br>parquet at PersistJob.java:35"]; } subgraph cluster97298 { label="Exchange"; 41103 [labelType="html" label="MapPartitionsRDD [41103]<br>parquet at PersistJob.java:35"]; } } 41094->41095; 41095->41096; 41097->41098; 41098->41099; 41096->41100; 41099->41100; 41100->41101; 41101->41102; 41102->41103; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time