3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16931 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 12
Input Size / Records:
16.0 MiB / 1115956
Associated Job Ids:
8234
DAG Visualization
digraph G { subgraph clusterstage_16931 { label="Stage 16931"; subgraph cluster108140 { label="Scan parquet "; 46235 [labelType="html" label="FileScanRDD [46235]<br>rdd at PersistJob.java:28"]; 46236 [labelType="html" label="MapPartitionsRDD [46236]<br>rdd at PersistJob.java:28"]; } subgraph cluster108136 { label="WholeStageCodegen (1)"; 46237 [labelType="html" label="MapPartitionsRDD [46237]<br>rdd at PersistJob.java:28"]; } subgraph cluster108151 { label="Scan csv "; 46238 [labelType="html" label="FileScanRDD [46238]<br>rdd at PersistJob.java:28"]; 46239 [labelType="html" label="MapPartitionsRDD [46239]<br>rdd at PersistJob.java:28"]; } subgraph cluster108147 { label="WholeStageCodegen (2)"; 46240 [labelType="html" label="MapPartitionsRDD [46240]<br>rdd at PersistJob.java:28"]; } subgraph cluster108135 { label="CartesianProduct"; 46241 [labelType="html" label="UnsafeCartesianRDD [46241]<br>rdd at PersistJob.java:28"]; 46242 [labelType="html" label="MapPartitionsRDD [46242]<br>rdd at PersistJob.java:28"]; } subgraph cluster108134 { label="Exchange"; 46243 [labelType="html" label="MapPartitionsRDD [46243]<br>rdd at PersistJob.java:28"]; } } 46235->46236; 46236->46237; 46238->46239; 46239->46240; 46237->46241; 46240->46241; 46241->46242; 46242->46243; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time