3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13547 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.8 MiB / 2231133
Associated Job Ids:
6787
DAG Visualization
digraph G { subgraph clusterstage_13547 { label="Stage 13547"; subgraph cluster88169 { label="Scan parquet "; 37463 [labelType="html" label="FileScanRDD [37463]<br>rdd at PersistJob.java:28"]; 37464 [labelType="html" label="MapPartitionsRDD [37464]<br>rdd at PersistJob.java:28"]; } subgraph cluster88164 { label="WholeStageCodegen (2)"; 37465 [labelType="html" label="MapPartitionsRDD [37465]<br>rdd at PersistJob.java:28"]; } subgraph cluster88174 { label="Scan csv "; 37466 [labelType="html" label="FileScanRDD [37466]<br>rdd at PersistJob.java:28"]; 37467 [labelType="html" label="MapPartitionsRDD [37467]<br>rdd at PersistJob.java:28"]; } subgraph cluster88170 { label="WholeStageCodegen (3)"; 37468 [labelType="html" label="MapPartitionsRDD [37468]<br>rdd at PersistJob.java:28"]; } subgraph cluster88163 { label="CartesianProduct"; 37469 [labelType="html" label="UnsafeCartesianRDD [37469]<br>rdd at PersistJob.java:28"]; 37470 [labelType="html" label="MapPartitionsRDD [37470]<br>rdd at PersistJob.java:28"]; } subgraph cluster88159 { label="WholeStageCodegen (4)"; 37471 [labelType="html" label="MapPartitionsRDD [37471]<br>rdd at PersistJob.java:28"]; } subgraph cluster88158 { label="ObjectHashAggregate"; 37472 [labelType="html" label="MapPartitionsRDD [37472]<br>rdd at PersistJob.java:28"]; } subgraph cluster88157 { label="Exchange"; 37473 [labelType="html" label="MapPartitionsRDD [37473]<br>rdd at PersistJob.java:28"]; } } 37463->37464; 37464->37465; 37466->37467; 37467->37468; 37465->37469; 37468->37469; 37469->37470; 37470->37471; 37471->37472; 37472->37473; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time