3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7412 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
34 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
65.7 MiB / 1116020
Shuffle Write Size / Records:
81.8 MiB / 1115956
Associated Job Ids:
3651
DAG Visualization
digraph G { subgraph clusterstage_7412 { label="Stage 7412"; subgraph cluster48228 { label="AQEShuffleRead"; 21294 [labelType="html" label="ShuffledRowRDD [21294] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48225 { label="WholeStageCodegen (42)"; 21295 [labelType="html" label="MapPartitionsRDD [21295] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48233 { label="AQEShuffleRead"; 21296 [labelType="html" label="ShuffledRowRDD [21296] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48230 { label="WholeStageCodegen (43)"; 21297 [labelType="html" label="MapPartitionsRDD [21297] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48219 { label="WholeStageCodegen (44)"; 21298 [labelType="html" label="ZippedPartitionsRDD2 [21298] [Unordered]<br>rdd at PersistJob.java:28"]; 21299 [labelType="html" label="MapPartitionsRDD [21299] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48238 { label="AQEShuffleRead"; 21300 [labelType="html" label="ShuffledRowRDD [21300] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48235 { label="WholeStageCodegen (45)"; 21301 [labelType="html" label="MapPartitionsRDD [21301] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48214 { label="WholeStageCodegen (46)"; 21302 [labelType="html" label="ZippedPartitionsRDD2 [21302] [Unordered]<br>rdd at PersistJob.java:28"]; 21303 [labelType="html" label="MapPartitionsRDD [21303] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster48213 { label="Exchange"; 21304 [labelType="html" label="MapPartitionsRDD [21304] [Unordered]<br>rdd at PersistJob.java:28"]; } } 21294->21295; 21296->21297; 21295->21298; 21297->21298; 21298->21299; 21300->21301; 21299->21302; 21301->21302; 21302->21303; 21303->21304; }
21293,21294
21220,21296
21224,21300
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time