3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15170 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.1 MiB / 34269
Shuffle Write Size / Records:
2.4 MiB / 34259
Associated Job Ids:
7983
DAG Visualization
digraph G { subgraph clusterstage_15170 { label="Stage 15170"; subgraph cluster97764 { label="Scan parquet "; 41307 [labelType="html" label="FileScanRDD [41307]<br>rdd at PersistJob.java:28"]; 41308 [labelType="html" label="MapPartitionsRDD [41308]<br>rdd at PersistJob.java:28"]; } subgraph cluster97759 { label="WholeStageCodegen (1)"; 41309 [labelType="html" label="MapPartitionsRDD [41309]<br>rdd at PersistJob.java:28"]; } subgraph cluster97769 { label="Scan csv "; 41310 [labelType="html" label="FileScanRDD [41310]<br>rdd at PersistJob.java:28"]; 41311 [labelType="html" label="MapPartitionsRDD [41311]<br>rdd at PersistJob.java:28"]; } subgraph cluster97765 { label="WholeStageCodegen (2)"; 41312 [labelType="html" label="MapPartitionsRDD [41312]<br>rdd at PersistJob.java:28"]; } subgraph cluster97758 { label="CartesianProduct"; 41313 [labelType="html" label="UnsafeCartesianRDD [41313]<br>rdd at PersistJob.java:28"]; 41314 [labelType="html" label="MapPartitionsRDD [41314]<br>rdd at PersistJob.java:28"]; } subgraph cluster97750 { label="WholeStageCodegen (3)"; 41315 [labelType="html" label="MapPartitionsRDD [41315]<br>rdd at PersistJob.java:28"]; } subgraph cluster97749 { label="Exchange"; 41316 [labelType="html" label="MapPartitionsRDD [41316]<br>rdd at PersistJob.java:28"]; } } 41307->41308; 41308->41309; 41310->41311; 41311->41312; 41309->41313; 41312->41313; 41313->41314; 41314->41315; 41315->41316; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time