3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16933 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 12
Input Size / Records:
16.0 MiB / 1115956
Associated Job Ids:
8236
DAG Visualization
digraph G { subgraph clusterstage_16933 { label="Stage 16933"; subgraph cluster108226 { label="Scan parquet "; 46267 [labelType="html" label="FileScanRDD [46267]<br>parquet at PersistJob.java:35"]; 46268 [labelType="html" label="MapPartitionsRDD [46268]<br>parquet at PersistJob.java:35"]; } subgraph cluster108222 { label="WholeStageCodegen (1)"; 46269 [labelType="html" label="MapPartitionsRDD [46269]<br>parquet at PersistJob.java:35"]; } subgraph cluster108231 { label="Scan csv "; 46270 [labelType="html" label="FileScanRDD [46270]<br>parquet at PersistJob.java:35"]; 46271 [labelType="html" label="MapPartitionsRDD [46271]<br>parquet at PersistJob.java:35"]; } subgraph cluster108227 { label="WholeStageCodegen (2)"; 46272 [labelType="html" label="MapPartitionsRDD [46272]<br>parquet at PersistJob.java:35"]; } subgraph cluster108221 { label="CartesianProduct"; 46273 [labelType="html" label="UnsafeCartesianRDD [46273]<br>parquet at PersistJob.java:35"]; 46274 [labelType="html" label="MapPartitionsRDD [46274]<br>parquet at PersistJob.java:35"]; } subgraph cluster108220 { label="Exchange"; 46275 [labelType="html" label="MapPartitionsRDD [46275]<br>parquet at PersistJob.java:35"]; } } 46267->46268; 46268->46269; 46270->46271; 46271->46272; 46269->46273; 46272->46273; 46273->46274; 46274->46275; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time