3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16679 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
157.2 MiB / 2200751
Shuffle Write Size / Records:
172.8 MiB / 2124462
Associated Job Ids:
8120
DAG Visualization
digraph G { subgraph clusterstage_16679 { label="Stage 16679"; subgraph cluster106479 { label="Exchange"; 45429 [labelType="html" label="ShuffledRowRDD [45429] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106475 { label="WholeStageCodegen (3)"; 45430 [labelType="html" label="MapPartitionsRDD [45430] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106490 { label="Exchange"; 45431 [labelType="html" label="ShuffledRowRDD [45431] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106486 { label="WholeStageCodegen (4)"; 45432 [labelType="html" label="MapPartitionsRDD [45432] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106485 { label="Window"; 45433 [labelType="html" label="MapPartitionsRDD [45433] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106481 { label="WholeStageCodegen (5)"; 45434 [labelType="html" label="MapPartitionsRDD [45434] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106471 { label="WholeStageCodegen (6)"; 45435 [labelType="html" label="ZippedPartitionsRDD2 [45435] [Unordered]<br>parquet at PersistJob.java:35"]; 45436 [labelType="html" label="MapPartitionsRDD [45436] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106470 { label="Exchange"; 45437 [labelType="html" label="MapPartitionsRDD [45437] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45429->45430; 45431->45432; 45432->45433; 45433->45434; 45430->45435; 45434->45435; 45435->45436; 45436->45437; }
45424,45429
45428,45431
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time