3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32637 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Output Size / Records:
408.7 KiB / 9394
Shuffle Read Size / Records:
4.6 MiB / 125311
Associated Job Ids:
17977
DAG Visualization
digraph G { subgraph clusterstage_32637 { label="Stage 32637"; subgraph cluster208179 { label="AQEShuffleRead"; 90109 [labelType="html" label="ShuffledRowRDD [90109] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208176 { label="WholeStageCodegen (12)"; 90110 [labelType="html" label="MapPartitionsRDD [90110] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208185 { label="AQEShuffleRead"; 90111 [labelType="html" label="ShuffledRowRDD [90111] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208184 { label="ObjectHashAggregate"; 90112 [labelType="html" label="MapPartitionsRDD [90112] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208181 { label="WholeStageCodegen (13)"; 90113 [labelType="html" label="MapPartitionsRDD [90113] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208169 { label="WholeStageCodegen (14)"; 90114 [labelType="html" label="ZippedPartitionsRDD2 [90114] [Unordered]<br>parquet at PersistJob.java:35"]; 90115 [labelType="html" label="MapPartitionsRDD [90115] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208168 { label="WriteFiles"; 90116 [labelType="html" label="MapPartitionsRDD [90116] [Unordered]<br>parquet at PersistJob.java:35"]; } } 90109->90110; 90111->90112; 90112->90113; 90110->90114; 90113->90114; 90114->90115; 90115->90116; }
90084,90109
90108,90111
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time