3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1069 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
7.1 MiB / 481086
Associated Job Ids:
504
DAG Visualization
digraph G { subgraph clusterstage_1069 { label="Stage 1069"; subgraph cluster7137 { label="AQEShuffleRead"; 3230 [labelType="html" label="ShuffledRowRDD [3230] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7134 { label="WholeStageCodegen (4)"; 3231 [labelType="html" label="MapPartitionsRDD [3231] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7133 { label="Window"; 3232 [labelType="html" label="MapPartitionsRDD [3232] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7127 { label="WholeStageCodegen (5)"; 3233 [labelType="html" label="MapPartitionsRDD [3233] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7141 { label="AQEShuffleRead"; 3234 [labelType="html" label="ShuffledRowRDD [3234] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7138 { label="WholeStageCodegen (6)"; 3235 [labelType="html" label="MapPartitionsRDD [3235] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7126 { label="Union"; 3236 [labelType="html" label="UnionRDD [3236] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster7125 { label="Exchange"; 3237 [labelType="html" label="MapPartitionsRDD [3237] [Unordered]<br>rdd at PersistJob.java:28"]; 3238 [labelType="html" label="MapPartitionsRDD [3238] [Unordered]<br>rdd at PersistJob.java:28"]; 3239 [labelType="html" label="MapPartitionsRDD [3239] [Unordered]<br>rdd at PersistJob.java:28"]; } } 3230->3231; 3231->3232; 3232->3233; 3234->3235; 3233->3236; 3235->3236; 3236->3237; 3237->3238; 3238->3239; }
3219,3230
3229,3234
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time