3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16217 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
9.9 MiB / 167755
Shuffle Write Size / Records:
14.1 MiB / 167745
Associated Job Ids:
7928
DAG Visualization
digraph G { subgraph clusterstage_16217 { label="Stage 16217"; subgraph cluster104023 { label="Scan parquet "; 44433 [labelType="html" label="FileScanRDD [44433]<br>rdd at PersistJob.java:28"]; 44434 [labelType="html" label="MapPartitionsRDD [44434]<br>rdd at PersistJob.java:28"]; } subgraph cluster104019 { label="WholeStageCodegen (1)"; 44435 [labelType="html" label="MapPartitionsRDD [44435]<br>rdd at PersistJob.java:28"]; } subgraph cluster104028 { label="Scan csv "; 44436 [labelType="html" label="FileScanRDD [44436]<br>rdd at PersistJob.java:28"]; 44437 [labelType="html" label="MapPartitionsRDD [44437]<br>rdd at PersistJob.java:28"]; } subgraph cluster104024 { label="WholeStageCodegen (2)"; 44438 [labelType="html" label="MapPartitionsRDD [44438]<br>rdd at PersistJob.java:28"]; } subgraph cluster104018 { label="CartesianProduct"; 44439 [labelType="html" label="UnsafeCartesianRDD [44439]<br>rdd at PersistJob.java:28"]; 44440 [labelType="html" label="MapPartitionsRDD [44440]<br>rdd at PersistJob.java:28"]; } subgraph cluster104014 { label="WholeStageCodegen (3)"; 44441 [labelType="html" label="MapPartitionsRDD [44441]<br>rdd at PersistJob.java:28"]; } subgraph cluster104013 { label="Exchange"; 44442 [labelType="html" label="MapPartitionsRDD [44442]<br>rdd at PersistJob.java:28"]; } } 44433->44434; 44434->44435; 44436->44437; 44437->44438; 44435->44439; 44438->44439; 44439->44440; 44440->44441; 44441->44442; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time