3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32524 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 5
Output Size / Records:
20.0 KiB / 4
Shuffle Read Size / Records:
5.3 MiB / 136129
Associated Job Ids:
17914
DAG Visualization
digraph G { subgraph clusterstage_32524 { label="Stage 32524"; subgraph cluster207085 { label="AQEShuffleRead"; 89628 [labelType="html" label="ShuffledRowRDD [89628] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207084 { label="ObjectHashAggregate"; 89629 [labelType="html" label="MapPartitionsRDD [89629] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207081 { label="WholeStageCodegen (5)"; 89630 [labelType="html" label="MapPartitionsRDD [89630] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207090 { label="AQEShuffleRead"; 89631 [labelType="html" label="ShuffledRowRDD [89631] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207087 { label="WholeStageCodegen (6)"; 89632 [labelType="html" label="MapPartitionsRDD [89632] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207066 { label="WholeStageCodegen (7)"; 89633 [labelType="html" label="ZippedPartitionsRDD2 [89633] [Unordered]<br>parquet at PersistJob.java:35"]; 89634 [labelType="html" label="MapPartitionsRDD [89634] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207065 { label="WriteFiles"; 89635 [labelType="html" label="MapPartitionsRDD [89635] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89628->89629; 89629->89630; 89631->89632; 89630->89633; 89632->89633; 89633->89634; 89634->89635; }
89593,89628
89597,89631
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time