3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13563 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
16.3 MiB / 2231133
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
3.9 KiB / 78
Associated Job Ids:
6801
DAG Visualization
digraph G { subgraph clusterstage_13563 { label="Stage 13563"; subgraph cluster88309 { label="Scan parquet "; 37558 [labelType="html" label="FileScanRDD [37558]<br>rdd at PersistJob.java:28"]; 37559 [labelType="html" label="MapPartitionsRDD [37559]<br>rdd at PersistJob.java:28"]; } subgraph cluster88304 { label="WholeStageCodegen (28)"; 37560 [labelType="html" label="MapPartitionsRDD [37560]<br>rdd at PersistJob.java:28"]; } subgraph cluster88312 { label="Exchange"; 37561 [labelType="html" label="ShuffledRowRDD [37561] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88310 { label="ObjectHashAggregate"; 37562 [labelType="html" label="MapPartitionsRDD [37562] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88303 { label="CartesianProduct"; 37563 [labelType="html" label="UnsafeCartesianRDD [37563] [Unordered]<br>rdd at PersistJob.java:28"]; 37564 [labelType="html" label="MapPartitionsRDD [37564] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88317 { label="Scan csv "; 37565 [labelType="html" label="FileScanRDD [37565]<br>rdd at PersistJob.java:28"]; 37566 [labelType="html" label="MapPartitionsRDD [37566]<br>rdd at PersistJob.java:28"]; } subgraph cluster88313 { label="WholeStageCodegen (29)"; 37567 [labelType="html" label="MapPartitionsRDD [37567]<br>rdd at PersistJob.java:28"]; } subgraph cluster88302 { label="CartesianProduct"; 37568 [labelType="html" label="UnsafeCartesianRDD [37568] [Unordered]<br>rdd at PersistJob.java:28"]; 37569 [labelType="html" label="MapPartitionsRDD [37569] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88298 { label="WholeStageCodegen (30)"; 37570 [labelType="html" label="MapPartitionsRDD [37570] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88297 { label="ObjectHashAggregate"; 37571 [labelType="html" label="MapPartitionsRDD [37571] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88296 { label="Exchange"; 37572 [labelType="html" label="MapPartitionsRDD [37572] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37558->37559; 37559->37560; 37561->37562; 37560->37563; 37562->37563; 37563->37564; 37565->37566; 37566->37567; 37564->37568; 37567->37568; 37568->37569; 37569->37570; 37570->37571; 37571->37572; }
37478,37561
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time