3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16841 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
52 s
Locality Level Summary:
Any: 10
Output Size / Records:
18.6 MiB / 258294
Shuffle Read Size / Records:
68.9 MiB / 258294
Associated Job Ids:
8162
DAG Visualization
digraph G { subgraph clusterstage_16841 { label="Stage 16841"; subgraph cluster107135 { label="Exchange"; 45720 [labelType="html" label="ShuffledRowRDD [45720] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107131 { label="WholeStageCodegen (25)"; 45721 [labelType="html" label="MapPartitionsRDD [45721] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107130 { label="Window"; 45722 [labelType="html" label="MapPartitionsRDD [45722] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107127 { label="WholeStageCodegen (26)"; 45723 [labelType="html" label="MapPartitionsRDD [45723] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107126 { label="Window"; 45724 [labelType="html" label="MapPartitionsRDD [45724] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107123 { label="WholeStageCodegen (27)"; 45725 [labelType="html" label="MapPartitionsRDD [45725] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107122 { label="Window"; 45726 [labelType="html" label="MapPartitionsRDD [45726] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107119 { label="WholeStageCodegen (28)"; 45727 [labelType="html" label="MapPartitionsRDD [45727] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107118 { label="Window"; 45728 [labelType="html" label="MapPartitionsRDD [45728] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107115 { label="WholeStageCodegen (29)"; 45729 [labelType="html" label="MapPartitionsRDD [45729] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107114 { label="WriteFiles"; 45730 [labelType="html" label="MapPartitionsRDD [45730] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45720->45721; 45721->45722; 45722->45723; 45723->45724; 45724->45725; 45725->45726; 45726->45727; 45727->45728; 45728->45729; 45729->45730; }
45719,45720
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time