3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7520 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2.8 min
Locality Level Summary:
Any: 10
Output Size / Records:
85.5 MiB / 1115956
Shuffle Read Size / Records:
81.8 MiB / 1115956
Spill (Memory):
2.6 GiB
Spill (Disk):
457.8 MiB
Associated Job Ids:
3671
DAG Visualization
digraph G { subgraph clusterstage_7520 { label="Stage 7520"; subgraph cluster48563 { label="Exchange"; 21446 [labelType="html" label="ShuffledRowRDD [21446] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48559 { label="WholeStageCodegen (47)"; 21447 [labelType="html" label="MapPartitionsRDD [21447] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48558 { label="Window"; 21448 [labelType="html" label="MapPartitionsRDD [21448] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48554 { label="WholeStageCodegen (48)"; 21449 [labelType="html" label="MapPartitionsRDD [21449] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48553 { label="Window"; 21450 [labelType="html" label="MapPartitionsRDD [21450] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48550 { label="WholeStageCodegen (49)"; 21451 [labelType="html" label="MapPartitionsRDD [21451] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48549 { label="Window"; 21452 [labelType="html" label="MapPartitionsRDD [21452] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48543 { label="WholeStageCodegen (50)"; 21453 [labelType="html" label="MapPartitionsRDD [21453] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48542 { label="Window"; 21454 [labelType="html" label="MapPartitionsRDD [21454] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48538 { label="WholeStageCodegen (51)"; 21455 [labelType="html" label="MapPartitionsRDD [21455] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48537 { label="Window"; 21456 [labelType="html" label="MapPartitionsRDD [21456] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48533 { label="WholeStageCodegen (52)"; 21457 [labelType="html" label="MapPartitionsRDD [21457] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48532 { label="Window"; 21458 [labelType="html" label="MapPartitionsRDD [21458] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48529 { label="WholeStageCodegen (53)"; 21459 [labelType="html" label="MapPartitionsRDD [21459] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48528 { label="WriteFiles"; 21460 [labelType="html" label="MapPartitionsRDD [21460] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21446->21447; 21447->21448; 21448->21449; 21449->21450; 21450->21451; 21451->21452; 21452->21453; 21453->21454; 21454->21455; 21455->21456; 21456->21457; 21457->21458; 21458->21459; 21459->21460; }
21445,21446
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time