3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32511 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
5.1 MiB / 591903
Shuffle Write Size / Records:
5.9 MiB / 591883
Associated Job Ids:
17905
DAG Visualization
digraph G { subgraph clusterstage_32511 { label="Stage 32511"; subgraph cluster206901 { label="Scan parquet "; 89538 [labelType="html" label="FileScanRDD [89538]<br>rdd at PersistJob.java:28"]; 89539 [labelType="html" label="MapPartitionsRDD [89539]<br>rdd at PersistJob.java:28"]; } subgraph cluster206896 { label="WholeStageCodegen (1)"; 89540 [labelType="html" label="MapPartitionsRDD [89540]<br>rdd at PersistJob.java:28"]; } subgraph cluster206906 { label="Scan csv "; 89541 [labelType="html" label="FileScanRDD [89541]<br>rdd at PersistJob.java:28"]; 89542 [labelType="html" label="MapPartitionsRDD [89542]<br>rdd at PersistJob.java:28"]; } subgraph cluster206902 { label="WholeStageCodegen (2)"; 89543 [labelType="html" label="MapPartitionsRDD [89543]<br>rdd at PersistJob.java:28"]; } subgraph cluster206895 { label="CartesianProduct"; 89544 [labelType="html" label="UnsafeCartesianRDD [89544]<br>rdd at PersistJob.java:28"]; 89545 [labelType="html" label="MapPartitionsRDD [89545]<br>rdd at PersistJob.java:28"]; } subgraph cluster206911 { label="Scan csv "; 89546 [labelType="html" label="FileScanRDD [89546]<br>rdd at PersistJob.java:28"]; 89547 [labelType="html" label="MapPartitionsRDD [89547]<br>rdd at PersistJob.java:28"]; } subgraph cluster206907 { label="WholeStageCodegen (3)"; 89548 [labelType="html" label="MapPartitionsRDD [89548]<br>rdd at PersistJob.java:28"]; } subgraph cluster206894 { label="CartesianProduct"; 89549 [labelType="html" label="UnsafeCartesianRDD [89549]<br>rdd at PersistJob.java:28"]; 89550 [labelType="html" label="MapPartitionsRDD [89550]<br>rdd at PersistJob.java:28"]; } subgraph cluster206891 { label="WholeStageCodegen (4)"; 89551 [labelType="html" label="MapPartitionsRDD [89551]<br>rdd at PersistJob.java:28"]; } subgraph cluster206890 { label="Exchange"; 89552 [labelType="html" label="MapPartitionsRDD [89552]<br>rdd at PersistJob.java:28"]; } } 89538->89539; 89539->89540; 89541->89542; 89542->89543; 89540->89544; 89543->89544; 89544->89545; 89546->89547; 89547->89548; 89545->89549; 89548->89549; 89549->89550; 89550->89551; 89551->89552; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time