3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9213 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.3 MiB / 133183
Shuffle Read Size / Records:
3.4 KiB / 10
Associated Job Ids:
4720
DAG Visualization
digraph G { subgraph clusterstage_9213 { label="Stage 9213"; subgraph cluster60718 { label="Scan parquet "; 26571 [labelType="html" label="FileScanRDD [26571]<br>rdd at PersistJob.java:28"]; 26572 [labelType="html" label="MapPartitionsRDD [26572]<br>rdd at PersistJob.java:28"]; } subgraph cluster60713 { label="WholeStageCodegen (34)"; 26573 [labelType="html" label="MapPartitionsRDD [26573]<br>rdd at PersistJob.java:28"]; } subgraph cluster60721 { label="Exchange"; 26574 [labelType="html" label="ShuffledRowRDD [26574] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60719 { label="ObjectHashAggregate"; 26575 [labelType="html" label="MapPartitionsRDD [26575] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60712 { label="CartesianProduct"; 26576 [labelType="html" label="UnsafeCartesianRDD [26576] [Unordered]<br>rdd at PersistJob.java:28"]; 26577 [labelType="html" label="MapPartitionsRDD [26577] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60726 { label="Scan csv "; 26578 [labelType="html" label="FileScanRDD [26578]<br>rdd at PersistJob.java:28"]; 26579 [labelType="html" label="MapPartitionsRDD [26579]<br>rdd at PersistJob.java:28"]; } subgraph cluster60722 { label="WholeStageCodegen (35)"; 26580 [labelType="html" label="MapPartitionsRDD [26580]<br>rdd at PersistJob.java:28"]; } subgraph cluster60711 { label="CartesianProduct"; 26581 [labelType="html" label="UnsafeCartesianRDD [26581] [Unordered]<br>rdd at PersistJob.java:28"]; 26582 [labelType="html" label="MapPartitionsRDD [26582] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60707 { label="WholeStageCodegen (36)"; 26583 [labelType="html" label="MapPartitionsRDD [26583] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60706 { label="ObjectHashAggregate"; 26584 [labelType="html" label="MapPartitionsRDD [26584] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60705 { label="Exchange"; 26585 [labelType="html" label="MapPartitionsRDD [26585] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26571->26572; 26572->26573; 26574->26575; 26573->26576; 26575->26576; 26576->26577; 26578->26579; 26579->26580; 26577->26581; 26580->26581; 26581->26582; 26582->26583; 26583->26584; 26584->26585; }
26471,26574
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time