3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15605 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
30.0 MiB / 597670
Shuffle Write Size / Records:
44.2 MiB / 597670
Associated Job Ids:
7694
DAG Visualization
digraph G { subgraph clusterstage_15605 { label="Stage 15605"; subgraph cluster100302 { label="AQEShuffleRead"; 42819 [labelType="html" label="ShuffledRowRDD [42819] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100299 { label="WholeStageCodegen (3)"; 42820 [labelType="html" label="MapPartitionsRDD [42820] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100298 { label="Window"; 42821 [labelType="html" label="MapPartitionsRDD [42821] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100294 { label="WholeStageCodegen (4)"; 42822 [labelType="html" label="MapPartitionsRDD [42822] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100293 { label="Window"; 42823 [labelType="html" label="MapPartitionsRDD [42823] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100289 { label="WholeStageCodegen (5)"; 42824 [labelType="html" label="MapPartitionsRDD [42824] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100288 { label="Exchange"; 42825 [labelType="html" label="MapPartitionsRDD [42825] [Unordered]<br>parquet at PersistJob.java:35"]; } } 42819->42820; 42820->42821; 42821->42822; 42822->42823; 42823->42824; 42824->42825; }
42814,42819
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time