3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7393 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
51 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
89.4 MiB / 1116233
Shuffle Write Size / Records:
65.7 MiB / 1115956
Associated Job Ids:
3650
DAG Visualization
digraph G { subgraph clusterstage_7393 { label="Stage 7393"; subgraph cluster48197 { label="AQEShuffleRead"; 21279 [labelType="html" label="ShuffledRowRDD [21279] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48194 { label="WholeStageCodegen (35)"; 21280 [labelType="html" label="MapPartitionsRDD [21280] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48202 { label="AQEShuffleRead"; 21281 [labelType="html" label="ShuffledRowRDD [21281] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48199 { label="WholeStageCodegen (36)"; 21282 [labelType="html" label="MapPartitionsRDD [21282] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48190 { label="WholeStageCodegen (37)"; 21283 [labelType="html" label="ZippedPartitionsRDD2 [21283] [Unordered]<br>rdd at PersistJob.java:28"]; 21284 [labelType="html" label="MapPartitionsRDD [21284] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48207 { label="AQEShuffleRead"; 21285 [labelType="html" label="ShuffledRowRDD [21285] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48204 { label="WholeStageCodegen (38)"; 21286 [labelType="html" label="MapPartitionsRDD [21286] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48186 { label="WholeStageCodegen (39)"; 21287 [labelType="html" label="ZippedPartitionsRDD2 [21287] [Unordered]<br>rdd at PersistJob.java:28"]; 21288 [labelType="html" label="MapPartitionsRDD [21288] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48212 { label="AQEShuffleRead"; 21289 [labelType="html" label="ShuffledRowRDD [21289] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48209 { label="WholeStageCodegen (40)"; 21290 [labelType="html" label="MapPartitionsRDD [21290] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48182 { label="WholeStageCodegen (41)"; 21291 [labelType="html" label="ZippedPartitionsRDD2 [21291] [Unordered]<br>rdd at PersistJob.java:28"]; 21292 [labelType="html" label="MapPartitionsRDD [21292] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48181 { label="Exchange"; 21293 [labelType="html" label="MapPartitionsRDD [21293] [Unordered]<br>rdd at PersistJob.java:28"]; } } 21279->21280; 21281->21282; 21280->21283; 21282->21283; 21283->21284; 21285->21286; 21284->21287; 21286->21287; 21287->21288; 21289->21290; 21288->21291; 21290->21291; 21291->21292; 21292->21293; }
21278,21279
21208,21281
21212,21285
21216,21289
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time