3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7532 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
157.7 MiB / 2208307
Shuffle Write Size / Records:
173.3 MiB / 2132018
Associated Job Ids:
3679
DAG Visualization
digraph G { subgraph clusterstage_7532 { label="Stage 7532"; subgraph cluster48792 { label="Exchange"; 21505 [labelType="html" label="ShuffledRowRDD [21505] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48788 { label="WholeStageCodegen (3)"; 21506 [labelType="html" label="MapPartitionsRDD [21506] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48803 { label="Exchange"; 21507 [labelType="html" label="ShuffledRowRDD [21507] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48799 { label="WholeStageCodegen (4)"; 21508 [labelType="html" label="MapPartitionsRDD [21508] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48798 { label="Window"; 21509 [labelType="html" label="MapPartitionsRDD [21509] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48794 { label="WholeStageCodegen (5)"; 21510 [labelType="html" label="MapPartitionsRDD [21510] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48784 { label="WholeStageCodegen (6)"; 21511 [labelType="html" label="ZippedPartitionsRDD2 [21511] [Unordered]<br>parquet at PersistJob.java:35"]; 21512 [labelType="html" label="MapPartitionsRDD [21512] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster48783 { label="Exchange"; 21513 [labelType="html" label="MapPartitionsRDD [21513] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21505->21506; 21507->21508; 21508->21509; 21509->21510; 21506->21511; 21510->21511; 21511->21512; 21512->21513; }
21500,21505
21504,21507
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time