3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16156 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.2 MiB / 284048
Associated Job Ids:
7905
DAG Visualization
digraph G { subgraph clusterstage_16156 { label="Stage 16156"; subgraph cluster103672 { label="AQEShuffleRead"; 44296 [labelType="html" label="ShuffledRowRDD [44296] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103669 { label="WholeStageCodegen (4)"; 44297 [labelType="html" label="MapPartitionsRDD [44297] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103668 { label="Window"; 44298 [labelType="html" label="MapPartitionsRDD [44298] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103662 { label="WholeStageCodegen (5)"; 44299 [labelType="html" label="MapPartitionsRDD [44299] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103676 { label="AQEShuffleRead"; 44300 [labelType="html" label="ShuffledRowRDD [44300] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103673 { label="WholeStageCodegen (6)"; 44301 [labelType="html" label="MapPartitionsRDD [44301] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103661 { label="Union"; 44302 [labelType="html" label="UnionRDD [44302] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103660 { label="Exchange"; 44303 [labelType="html" label="MapPartitionsRDD [44303] [Unordered]<br>rdd at PersistJob.java:28"]; 44304 [labelType="html" label="MapPartitionsRDD [44304] [Unordered]<br>rdd at PersistJob.java:28"]; 44305 [labelType="html" label="MapPartitionsRDD [44305] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44296->44297; 44297->44298; 44298->44299; 44300->44301; 44299->44302; 44301->44302; 44302->44303; 44303->44304; 44304->44305; }
44285,44296
44295,44300
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time