3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32582 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
26 s
Locality Level Summary:
Any: 5
Output Size / Records:
1982.7 KiB / 43879
Shuffle Read Size / Records:
6.4 MiB / 1066320
Spill (Memory):
1200.0 MiB
Spill (Disk):
15.4 MiB
Associated Job Ids:
17947
DAG Visualization
digraph G { subgraph clusterstage_32582 { label="Stage 32582"; subgraph cluster207647 { label="AQEShuffleRead"; 89874 [labelType="html" label="ShuffledRowRDD [89874] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207644 { label="WholeStageCodegen (4)"; 89875 [labelType="html" label="MapPartitionsRDD [89875] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207643 { label="Window"; 89876 [labelType="html" label="MapPartitionsRDD [89876] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207640 { label="WholeStageCodegen (5)"; 89877 [labelType="html" label="MapPartitionsRDD [89877] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207639 { label="Window"; 89878 [labelType="html" label="MapPartitionsRDD [89878] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207636 { label="WholeStageCodegen (6)"; 89879 [labelType="html" label="MapPartitionsRDD [89879] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207652 { label="AQEShuffleRead"; 89880 [labelType="html" label="ShuffledRowRDD [89880] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207649 { label="WholeStageCodegen (7)"; 89881 [labelType="html" label="MapPartitionsRDD [89881] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207631 { label="WholeStageCodegen (8)"; 89882 [labelType="html" label="ZippedPartitionsRDD2 [89882] [Unordered]<br>parquet at PersistJob.java:35"]; 89883 [labelType="html" label="MapPartitionsRDD [89883] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207630 { label="Window"; 89884 [labelType="html" label="MapPartitionsRDD [89884] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207620 { label="WholeStageCodegen (9)"; 89885 [labelType="html" label="MapPartitionsRDD [89885] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207619 { label="WriteFiles"; 89886 [labelType="html" label="MapPartitionsRDD [89886] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89874->89875; 89875->89876; 89876->89877; 89877->89878; 89878->89879; 89880->89881; 89879->89882; 89881->89882; 89882->89883; 89883->89884; 89884->89885; 89885->89886; }
89857,89874
89866,89880
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time