3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32563 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
4.5 MiB / 591893
Shuffle Write Size / Records:
4.7 MiB / 591883
Associated Job Ids:
17938
DAG Visualization
digraph G { subgraph clusterstage_32563 { label="Stage 32563"; subgraph cluster207445 { label="Scan parquet "; 89799 [labelType="html" label="FileScanRDD [89799]<br>rdd at PersistJob.java:28"]; 89800 [labelType="html" label="MapPartitionsRDD [89800]<br>rdd at PersistJob.java:28"]; } subgraph cluster207441 { label="WholeStageCodegen (1)"; 89801 [labelType="html" label="MapPartitionsRDD [89801]<br>rdd at PersistJob.java:28"]; } subgraph cluster207450 { label="Scan csv "; 89802 [labelType="html" label="FileScanRDD [89802]<br>rdd at PersistJob.java:28"]; 89803 [labelType="html" label="MapPartitionsRDD [89803]<br>rdd at PersistJob.java:28"]; } subgraph cluster207446 { label="WholeStageCodegen (2)"; 89804 [labelType="html" label="MapPartitionsRDD [89804]<br>rdd at PersistJob.java:28"]; } subgraph cluster207440 { label="CartesianProduct"; 89805 [labelType="html" label="UnsafeCartesianRDD [89805]<br>rdd at PersistJob.java:28"]; 89806 [labelType="html" label="MapPartitionsRDD [89806]<br>rdd at PersistJob.java:28"]; } subgraph cluster207439 { label="Exchange"; 89807 [labelType="html" label="MapPartitionsRDD [89807]<br>rdd at PersistJob.java:28"]; } } 89799->89800; 89800->89801; 89802->89803; 89803->89804; 89801->89805; 89804->89805; 89805->89806; 89806->89807; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time