3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15114 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1355.2 KiB / 85900
Shuffle Write Size / Records:
1606.6 KiB / 85895
Associated Job Ids:
7948
DAG Visualization
digraph G { subgraph clusterstage_15114 { label="Stage 15114"; subgraph cluster97228 { label="Scan parquet "; 41053 [labelType="html" label="FileScanRDD [41053]<br>rdd at PersistJob.java:28"]; 41054 [labelType="html" label="MapPartitionsRDD [41054]<br>rdd at PersistJob.java:28"]; } subgraph cluster97224 { label="WholeStageCodegen (1)"; 41055 [labelType="html" label="MapPartitionsRDD [41055]<br>rdd at PersistJob.java:28"]; } subgraph cluster97233 { label="Scan csv "; 41056 [labelType="html" label="FileScanRDD [41056]<br>rdd at PersistJob.java:28"]; 41057 [labelType="html" label="MapPartitionsRDD [41057]<br>rdd at PersistJob.java:28"]; } subgraph cluster97229 { label="WholeStageCodegen (2)"; 41058 [labelType="html" label="MapPartitionsRDD [41058]<br>rdd at PersistJob.java:28"]; } subgraph cluster97223 { label="CartesianProduct"; 41059 [labelType="html" label="UnsafeCartesianRDD [41059]<br>rdd at PersistJob.java:28"]; 41060 [labelType="html" label="MapPartitionsRDD [41060]<br>rdd at PersistJob.java:28"]; } subgraph cluster97220 { label="WholeStageCodegen (3)"; 41061 [labelType="html" label="MapPartitionsRDD [41061]<br>rdd at PersistJob.java:28"]; } subgraph cluster97219 { label="Exchange"; 41062 [labelType="html" label="MapPartitionsRDD [41062]<br>rdd at PersistJob.java:28"]; } } 41053->41054; 41054->41055; 41056->41057; 41057->41058; 41055->41059; 41058->41059; 41059->41060; 41060->41061; 41061->41062; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time