3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16877 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 s
Locality Level Summary:
Any: 10
Output Size / Records:
112.9 KiB / 1326
Shuffle Read Size / Records:
24.8 MiB / 1374250
Associated Job Ids:
8196
DAG Visualization
digraph G { subgraph clusterstage_16877 { label="Stage 16877"; subgraph cluster107568 { label="Exchange"; 45930 [labelType="html" label="ShuffledRowRDD [45930] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107564 { label="WholeStageCodegen (5)"; 45931 [labelType="html" label="MapPartitionsRDD [45931] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107563 { label="Window"; 45932 [labelType="html" label="MapPartitionsRDD [45932] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107559 { label="WholeStageCodegen (6)"; 45933 [labelType="html" label="MapPartitionsRDD [45933] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107574 { label="Exchange"; 45934 [labelType="html" label="ShuffledRowRDD [45934] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107570 { label="WholeStageCodegen (7)"; 45935 [labelType="html" label="MapPartitionsRDD [45935] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107554 { label="WholeStageCodegen (8)"; 45936 [labelType="html" label="ZippedPartitionsRDD2 [45936] [Unordered]<br>parquet at PersistJob.java:35"]; 45937 [labelType="html" label="MapPartitionsRDD [45937] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107553 { label="Window"; 45938 [labelType="html" label="MapPartitionsRDD [45938] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107538 { label="WholeStageCodegen (9)"; 45939 [labelType="html" label="MapPartitionsRDD [45939] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107537 { label="WriteFiles"; 45940 [labelType="html" label="MapPartitionsRDD [45940] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45930->45931; 45931->45932; 45932->45933; 45934->45935; 45933->45936; 45935->45936; 45936->45937; 45937->45938; 45938->45939; 45939->45940; }
45909,45930
45914,45934
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time