3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17031 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.8 MiB / 414221
Associated Job Ids:
8302
DAG Visualization
digraph G { subgraph clusterstage_17031 { label="Stage 17031"; subgraph cluster109264 { label="AQEShuffleRead"; 46712 [labelType="html" label="ShuffledRowRDD [46712] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109261 { label="WholeStageCodegen (4)"; 46713 [labelType="html" label="MapPartitionsRDD [46713] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109260 { label="Window"; 46714 [labelType="html" label="MapPartitionsRDD [46714] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109254 { label="WholeStageCodegen (5)"; 46715 [labelType="html" label="MapPartitionsRDD [46715] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109268 { label="AQEShuffleRead"; 46716 [labelType="html" label="ShuffledRowRDD [46716] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109265 { label="WholeStageCodegen (6)"; 46717 [labelType="html" label="MapPartitionsRDD [46717] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109253 { label="Union"; 46718 [labelType="html" label="UnionRDD [46718] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster109252 { label="Exchange"; 46719 [labelType="html" label="MapPartitionsRDD [46719] [Unordered]<br>rdd at PersistJob.java:28"]; 46720 [labelType="html" label="MapPartitionsRDD [46720] [Unordered]<br>rdd at PersistJob.java:28"]; 46721 [labelType="html" label="MapPartitionsRDD [46721] [Unordered]<br>rdd at PersistJob.java:28"]; } } 46712->46713; 46713->46714; 46714->46715; 46716->46717; 46715->46718; 46717->46718; 46718->46719; 46719->46720; 46720->46721; }
46701,46712
46711,46716
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time