3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7365 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
35 s
Locality Level Summary:
Any: 10
Input Size / Records:
36.0 KiB / 10
Shuffle Read Size / Records:
34.9 MiB / 1240727
Shuffle Write Size / Records:
76.7 MiB / 1115956
Associated Job Ids:
3648
DAG Visualization
digraph G { subgraph clusterstage_7365 { label="Stage 7365"; subgraph cluster48135 { label="Exchange"; 21249 [labelType="html" label="ShuffledRowRDD [21249] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48131 { label="WholeStageCodegen (22)"; 21250 [labelType="html" label="MapPartitionsRDD [21250] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48146 { label="Exchange"; 21251 [labelType="html" label="ShuffledRowRDD [21251] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48142 { label="WholeStageCodegen (23)"; 21252 [labelType="html" label="MapPartitionsRDD [21252] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48141 { label="Window"; 21253 [labelType="html" label="MapPartitionsRDD [21253] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48137 { label="WholeStageCodegen (24)"; 21254 [labelType="html" label="MapPartitionsRDD [21254] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48125 { label="WholeStageCodegen (25)"; 21255 [labelType="html" label="ZippedPartitionsRDD2 [21255] [Unordered]<br>rdd at PersistJob.java:28"]; 21256 [labelType="html" label="MapPartitionsRDD [21256] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48124 { label="Window"; 21257 [labelType="html" label="MapPartitionsRDD [21257] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48121 { label="WholeStageCodegen (26)"; 21258 [labelType="html" label="MapPartitionsRDD [21258] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48157 { label="Exchange"; 21259 [labelType="html" label="ShuffledRowRDD [21259] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48153 { label="WholeStageCodegen (27)"; 21260 [labelType="html" label="MapPartitionsRDD [21260] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48152 { label="Window"; 21261 [labelType="html" label="MapPartitionsRDD [21261] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48148 { label="WholeStageCodegen (28)"; 21262 [labelType="html" label="MapPartitionsRDD [21262] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48115 { label="WholeStageCodegen (29)"; 21263 [labelType="html" label="ZippedPartitionsRDD2 [21263] [Unordered]<br>rdd at PersistJob.java:28"]; 21264 [labelType="html" label="MapPartitionsRDD [21264] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48162 { label="Scan parquet "; 21265 [labelType="html" label="FileScanRDD [21265]<br>rdd at PersistJob.java:28"]; 21266 [labelType="html" label="MapPartitionsRDD [21266]<br>rdd at PersistJob.java:28"]; } subgraph cluster48158 { label="WholeStageCodegen (30)"; 21267 [labelType="html" label="MapPartitionsRDD [21267]<br>rdd at PersistJob.java:28"]; } subgraph cluster48114 { label="CartesianProduct"; 21268 [labelType="html" label="UnsafeCartesianRDD [21268] [Unordered]<br>rdd at PersistJob.java:28"]; 21269 [labelType="html" label="MapPartitionsRDD [21269] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48111 { label="WholeStageCodegen (31)"; 21270 [labelType="html" label="MapPartitionsRDD [21270] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48110 { label="Exchange"; 21271 [labelType="html" label="MapPartitionsRDD [21271] [Unordered]<br>rdd at PersistJob.java:28"]; } } 21249->21250; 21251->21252; 21252->21253; 21253->21254; 21250->21255; 21254->21255; 21255->21256; 21256->21257; 21257->21258; 21259->21260; 21260->21261; 21261->21262; 21258->21263; 21262->21263; 21263->21264; 21265->21266; 21266->21267; 21264->21268; 21267->21268; 21268->21269; 21269->21270; 21270->21271; }
21184,21249
21248,21251
21200,21259
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time