3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13571 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
14.5 MiB / 2231133
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
6805
DAG Visualization
digraph G { subgraph clusterstage_13571 { label="Stage 13571"; subgraph cluster88397 { label="Scan parquet "; 37618 [labelType="html" label="FileScanRDD [37618]<br>rdd at PersistJob.java:28"]; 37619 [labelType="html" label="MapPartitionsRDD [37619]<br>rdd at PersistJob.java:28"]; } subgraph cluster88392 { label="WholeStageCodegen (40)"; 37620 [labelType="html" label="MapPartitionsRDD [37620]<br>rdd at PersistJob.java:28"]; } subgraph cluster88400 { label="Exchange"; 37621 [labelType="html" label="ShuffledRowRDD [37621] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88398 { label="ObjectHashAggregate"; 37622 [labelType="html" label="MapPartitionsRDD [37622] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88391 { label="CartesianProduct"; 37623 [labelType="html" label="UnsafeCartesianRDD [37623] [Unordered]<br>rdd at PersistJob.java:28"]; 37624 [labelType="html" label="MapPartitionsRDD [37624] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88405 { label="Scan csv "; 37625 [labelType="html" label="FileScanRDD [37625]<br>rdd at PersistJob.java:28"]; 37626 [labelType="html" label="MapPartitionsRDD [37626]<br>rdd at PersistJob.java:28"]; } subgraph cluster88401 { label="WholeStageCodegen (41)"; 37627 [labelType="html" label="MapPartitionsRDD [37627]<br>rdd at PersistJob.java:28"]; } subgraph cluster88390 { label="CartesianProduct"; 37628 [labelType="html" label="UnsafeCartesianRDD [37628] [Unordered]<br>rdd at PersistJob.java:28"]; 37629 [labelType="html" label="MapPartitionsRDD [37629] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88386 { label="WholeStageCodegen (42)"; 37630 [labelType="html" label="MapPartitionsRDD [37630] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88385 { label="ObjectHashAggregate"; 37631 [labelType="html" label="MapPartitionsRDD [37631] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88384 { label="Exchange"; 37632 [labelType="html" label="MapPartitionsRDD [37632] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37618->37619; 37619->37620; 37621->37622; 37620->37623; 37622->37623; 37623->37624; 37625->37626; 37626->37627; 37624->37628; 37627->37628; 37628->37629; 37629->37630; 37630->37631; 37631->37632; }
37498,37621
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time