3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16573 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
124.4 MiB / 2200751
Shuffle Write Size / Records:
25.2 MiB / 2124462
Associated Job Ids:
8104
DAG Visualization
digraph G { subgraph clusterstage_16573 { label="Stage 16573"; subgraph cluster106043 { label="Exchange"; 45290 [labelType="html" label="ShuffledRowRDD [45290] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106039 { label="WholeStageCodegen (12)"; 45291 [labelType="html" label="MapPartitionsRDD [45291] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106054 { label="Exchange"; 45292 [labelType="html" label="ShuffledRowRDD [45292] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106050 { label="WholeStageCodegen (13)"; 45293 [labelType="html" label="MapPartitionsRDD [45293] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106049 { label="Window"; 45294 [labelType="html" label="MapPartitionsRDD [45294] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106045 { label="WholeStageCodegen (14)"; 45295 [labelType="html" label="MapPartitionsRDD [45295] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106035 { label="WholeStageCodegen (15)"; 45296 [labelType="html" label="ZippedPartitionsRDD2 [45296] [Unordered]<br>parquet at PersistJob.java:35"]; 45297 [labelType="html" label="MapPartitionsRDD [45297] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106034 { label="Exchange"; 45298 [labelType="html" label="MapPartitionsRDD [45298] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45290->45291; 45292->45293; 45293->45294; 45294->45295; 45291->45296; 45295->45296; 45296->45297; 45297->45298; }
45253,45290
45257,45292
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time