3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7500 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
27 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
65.7 MiB / 1116020
Shuffle Write Size / Records:
81.8 MiB / 1115956
Associated Job Ids:
3670
DAG Visualization
digraph G { subgraph clusterstage_7500 { label="Stage 7500"; subgraph cluster48517 { label="AQEShuffleRead"; 21435 [labelType="html" label="ShuffledRowRDD [21435] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48514 { label="WholeStageCodegen (42)"; 21436 [labelType="html" label="MapPartitionsRDD [21436] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48522 { label="AQEShuffleRead"; 21437 [labelType="html" label="ShuffledRowRDD [21437] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48519 { label="WholeStageCodegen (43)"; 21438 [labelType="html" label="MapPartitionsRDD [21438] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48508 { label="WholeStageCodegen (44)"; 21439 [labelType="html" label="ZippedPartitionsRDD2 [21439] [Unordered]<br>parquet at PersistJob.java:35"]; 21440 [labelType="html" label="MapPartitionsRDD [21440] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48527 { label="AQEShuffleRead"; 21441 [labelType="html" label="ShuffledRowRDD [21441] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48524 { label="WholeStageCodegen (45)"; 21442 [labelType="html" label="MapPartitionsRDD [21442] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48503 { label="WholeStageCodegen (46)"; 21443 [labelType="html" label="ZippedPartitionsRDD2 [21443] [Unordered]<br>parquet at PersistJob.java:35"]; 21444 [labelType="html" label="MapPartitionsRDD [21444] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48502 { label="Exchange"; 21445 [labelType="html" label="MapPartitionsRDD [21445] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21435->21436; 21437->21438; 21436->21439; 21438->21439; 21439->21440; 21441->21442; 21440->21443; 21442->21443; 21443->21444; 21444->21445; }
21434,21435
21361,21437
21365,21441
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time