3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9211 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.3 MiB / 133183
Shuffle Read Size / Records:
1840.0 B / 10
Shuffle Write Size / Records:
14.3 KiB / 493
Associated Job Ids:
4719
DAG Visualization
digraph G { subgraph clusterstage_9211 { label="Stage 9211"; subgraph cluster60696 { label="Scan parquet "; 26556 [labelType="html" label="FileScanRDD [26556]<br>rdd at PersistJob.java:28"]; 26557 [labelType="html" label="MapPartitionsRDD [26557]<br>rdd at PersistJob.java:28"]; } subgraph cluster60691 { label="WholeStageCodegen (31)"; 26558 [labelType="html" label="MapPartitionsRDD [26558]<br>rdd at PersistJob.java:28"]; } subgraph cluster60699 { label="Exchange"; 26559 [labelType="html" label="ShuffledRowRDD [26559] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60697 { label="ObjectHashAggregate"; 26560 [labelType="html" label="MapPartitionsRDD [26560] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60690 { label="CartesianProduct"; 26561 [labelType="html" label="UnsafeCartesianRDD [26561] [Unordered]<br>rdd at PersistJob.java:28"]; 26562 [labelType="html" label="MapPartitionsRDD [26562] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60704 { label="Scan csv "; 26563 [labelType="html" label="FileScanRDD [26563]<br>rdd at PersistJob.java:28"]; 26564 [labelType="html" label="MapPartitionsRDD [26564]<br>rdd at PersistJob.java:28"]; } subgraph cluster60700 { label="WholeStageCodegen (32)"; 26565 [labelType="html" label="MapPartitionsRDD [26565]<br>rdd at PersistJob.java:28"]; } subgraph cluster60689 { label="CartesianProduct"; 26566 [labelType="html" label="UnsafeCartesianRDD [26566] [Unordered]<br>rdd at PersistJob.java:28"]; 26567 [labelType="html" label="MapPartitionsRDD [26567] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60685 { label="WholeStageCodegen (33)"; 26568 [labelType="html" label="MapPartitionsRDD [26568] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60684 { label="ObjectHashAggregate"; 26569 [labelType="html" label="MapPartitionsRDD [26569] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60683 { label="Exchange"; 26570 [labelType="html" label="MapPartitionsRDD [26570] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26556->26557; 26557->26558; 26559->26560; 26558->26561; 26560->26561; 26561->26562; 26563->26564; 26564->26565; 26562->26566; 26565->26566; 26566->26567; 26567->26568; 26568->26569; 26569->26570; }
26466,26559
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time