3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16316 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
10.0 MiB / 169558
Shuffle Write Size / Records:
14.2 MiB / 169548
Associated Job Ids:
8513
DAG Visualization
digraph G { subgraph clusterstage_16316 { label="Stage 16316"; subgraph cluster105375 { label="Scan parquet "; 44529 [labelType="html" label="FileScanRDD [44529]<br>parquet at PersistJob.java:35"]; 44530 [labelType="html" label="MapPartitionsRDD [44530]<br>parquet at PersistJob.java:35"]; } subgraph cluster105371 { label="WholeStageCodegen (1)"; 44531 [labelType="html" label="MapPartitionsRDD [44531]<br>parquet at PersistJob.java:35"]; } subgraph cluster105380 { label="Scan csv "; 44532 [labelType="html" label="FileScanRDD [44532]<br>parquet at PersistJob.java:35"]; 44533 [labelType="html" label="MapPartitionsRDD [44533]<br>parquet at PersistJob.java:35"]; } subgraph cluster105376 { label="WholeStageCodegen (2)"; 44534 [labelType="html" label="MapPartitionsRDD [44534]<br>parquet at PersistJob.java:35"]; } subgraph cluster105370 { label="CartesianProduct"; 44535 [labelType="html" label="UnsafeCartesianRDD [44535]<br>parquet at PersistJob.java:35"]; 44536 [labelType="html" label="MapPartitionsRDD [44536]<br>parquet at PersistJob.java:35"]; } subgraph cluster105366 { label="WholeStageCodegen (3)"; 44537 [labelType="html" label="MapPartitionsRDD [44537]<br>parquet at PersistJob.java:35"]; } subgraph cluster105365 { label="Exchange"; 44538 [labelType="html" label="MapPartitionsRDD [44538]<br>parquet at PersistJob.java:35"]; } } 44529->44530; 44530->44531; 44532->44533; 44533->44534; 44531->44535; 44534->44535; 44535->44536; 44536->44537; 44537->44538; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time