3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7481 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
39 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
89.4 MiB / 1116233
Shuffle Write Size / Records:
65.7 MiB / 1115956
Associated Job Ids:
3669
DAG Visualization
digraph G { subgraph clusterstage_7481 { label="Stage 7481"; subgraph cluster48486 { label="AQEShuffleRead"; 21420 [labelType="html" label="ShuffledRowRDD [21420] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48483 { label="WholeStageCodegen (35)"; 21421 [labelType="html" label="MapPartitionsRDD [21421] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48491 { label="AQEShuffleRead"; 21422 [labelType="html" label="ShuffledRowRDD [21422] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48488 { label="WholeStageCodegen (36)"; 21423 [labelType="html" label="MapPartitionsRDD [21423] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48479 { label="WholeStageCodegen (37)"; 21424 [labelType="html" label="ZippedPartitionsRDD2 [21424] [Unordered]<br>parquet at PersistJob.java:35"]; 21425 [labelType="html" label="MapPartitionsRDD [21425] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48496 { label="AQEShuffleRead"; 21426 [labelType="html" label="ShuffledRowRDD [21426] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48493 { label="WholeStageCodegen (38)"; 21427 [labelType="html" label="MapPartitionsRDD [21427] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48475 { label="WholeStageCodegen (39)"; 21428 [labelType="html" label="ZippedPartitionsRDD2 [21428] [Unordered]<br>parquet at PersistJob.java:35"]; 21429 [labelType="html" label="MapPartitionsRDD [21429] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48501 { label="AQEShuffleRead"; 21430 [labelType="html" label="ShuffledRowRDD [21430] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48498 { label="WholeStageCodegen (40)"; 21431 [labelType="html" label="MapPartitionsRDD [21431] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48471 { label="WholeStageCodegen (41)"; 21432 [labelType="html" label="ZippedPartitionsRDD2 [21432] [Unordered]<br>parquet at PersistJob.java:35"]; 21433 [labelType="html" label="MapPartitionsRDD [21433] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48470 { label="Exchange"; 21434 [labelType="html" label="MapPartitionsRDD [21434] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21420->21421; 21422->21423; 21421->21424; 21423->21424; 21424->21425; 21426->21427; 21425->21428; 21427->21428; 21428->21429; 21430->21431; 21429->21432; 21431->21432; 21432->21433; 21433->21434; }
21419,21420
21349,21422
21353,21426
21357,21430
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time