3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8492 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259495
Shuffle Write Size / Records:
20.8 MiB / 259485
Associated Job Ids:
4215
DAG Visualization
digraph G { subgraph clusterstage_8492 { label="Stage 8492"; subgraph cluster55690 { label="Scan parquet "; 24429 [labelType="html" label="FileScanRDD [24429]<br>rdd at PersistJob.java:28"]; 24430 [labelType="html" label="MapPartitionsRDD [24430]<br>rdd at PersistJob.java:28"]; } subgraph cluster55686 { label="WholeStageCodegen (1)"; 24431 [labelType="html" label="MapPartitionsRDD [24431]<br>rdd at PersistJob.java:28"]; } subgraph cluster55695 { label="Scan csv "; 24432 [labelType="html" label="FileScanRDD [24432]<br>rdd at PersistJob.java:28"]; 24433 [labelType="html" label="MapPartitionsRDD [24433]<br>rdd at PersistJob.java:28"]; } subgraph cluster55691 { label="WholeStageCodegen (2)"; 24434 [labelType="html" label="MapPartitionsRDD [24434]<br>rdd at PersistJob.java:28"]; } subgraph cluster55685 { label="CartesianProduct"; 24435 [labelType="html" label="UnsafeCartesianRDD [24435]<br>rdd at PersistJob.java:28"]; 24436 [labelType="html" label="MapPartitionsRDD [24436]<br>rdd at PersistJob.java:28"]; } subgraph cluster55681 { label="WholeStageCodegen (3)"; 24437 [labelType="html" label="MapPartitionsRDD [24437]<br>rdd at PersistJob.java:28"]; } subgraph cluster55680 { label="Exchange"; 24438 [labelType="html" label="MapPartitionsRDD [24438]<br>rdd at PersistJob.java:28"]; } } 24429->24430; 24430->24431; 24432->24433; 24433->24434; 24431->24435; 24434->24435; 24435->24436; 24436->24437; 24437->24438; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time