3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32631 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
965.6 KiB / 80747
Shuffle Write Size / Records:
1360.8 KiB / 76696
Associated Job Ids:
17976
DAG Visualization
digraph G { subgraph clusterstage_32631 { label="Stage 32631"; subgraph cluster208157 { label="AQEShuffleRead"; 90097 [labelType="html" label="ShuffledRowRDD [90097] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208154 { label="WholeStageCodegen (7)"; 90098 [labelType="html" label="MapPartitionsRDD [90098] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208162 { label="AQEShuffleRead"; 90099 [labelType="html" label="ShuffledRowRDD [90099] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208159 { label="WholeStageCodegen (8)"; 90100 [labelType="html" label="MapPartitionsRDD [90100] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208150 { label="WholeStageCodegen (9)"; 90101 [labelType="html" label="ZippedPartitionsRDD2 [90101] [Unordered]<br>parquet at PersistJob.java:35"]; 90102 [labelType="html" label="MapPartitionsRDD [90102] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208167 { label="AQEShuffleRead"; 90103 [labelType="html" label="ShuffledRowRDD [90103] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208164 { label="WholeStageCodegen (10)"; 90104 [labelType="html" label="MapPartitionsRDD [90104] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208146 { label="WholeStageCodegen (11)"; 90105 [labelType="html" label="ZippedPartitionsRDD2 [90105] [Unordered]<br>parquet at PersistJob.java:35"]; 90106 [labelType="html" label="MapPartitionsRDD [90106] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208145 { label="ObjectHashAggregate"; 90107 [labelType="html" label="MapPartitionsRDD [90107] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster208144 { label="Exchange"; 90108 [labelType="html" label="MapPartitionsRDD [90108] [Unordered]<br>parquet at PersistJob.java:35"]; } } 90097->90098; 90099->90100; 90098->90101; 90100->90101; 90101->90102; 90103->90104; 90102->90105; 90104->90105; 90105->90106; 90106->90107; 90107->90108; }
90088,90097
90092,90099
90096,90103
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time