3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15814 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.8 MiB / 2231133
Associated Job Ids:
7991
DAG Visualization
digraph G { subgraph clusterstage_15814 { label="Stage 15814"; subgraph cluster103307 { label="Scan parquet "; 44215 [labelType="html" label="FileScanRDD [44215]<br>parquet at PersistJob.java:35"]; 44216 [labelType="html" label="MapPartitionsRDD [44216]<br>parquet at PersistJob.java:35"]; } subgraph cluster103302 { label="WholeStageCodegen (2)"; 44217 [labelType="html" label="MapPartitionsRDD [44217]<br>parquet at PersistJob.java:35"]; } subgraph cluster103312 { label="Scan csv "; 44218 [labelType="html" label="FileScanRDD [44218]<br>parquet at PersistJob.java:35"]; 44219 [labelType="html" label="MapPartitionsRDD [44219]<br>parquet at PersistJob.java:35"]; } subgraph cluster103308 { label="WholeStageCodegen (3)"; 44220 [labelType="html" label="MapPartitionsRDD [44220]<br>parquet at PersistJob.java:35"]; } subgraph cluster103301 { label="CartesianProduct"; 44221 [labelType="html" label="UnsafeCartesianRDD [44221]<br>parquet at PersistJob.java:35"]; 44222 [labelType="html" label="MapPartitionsRDD [44222]<br>parquet at PersistJob.java:35"]; } subgraph cluster103297 { label="WholeStageCodegen (4)"; 44223 [labelType="html" label="MapPartitionsRDD [44223]<br>parquet at PersistJob.java:35"]; } subgraph cluster103296 { label="ObjectHashAggregate"; 44224 [labelType="html" label="MapPartitionsRDD [44224]<br>parquet at PersistJob.java:35"]; } subgraph cluster103295 { label="Exchange"; 44225 [labelType="html" label="MapPartitionsRDD [44225]<br>parquet at PersistJob.java:35"]; } } 44215->44216; 44216->44217; 44218->44219; 44219->44220; 44217->44221; 44220->44221; 44221->44222; 44222->44223; 44223->44224; 44224->44225; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time