3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16160 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.2 MiB / 284048
Shuffle Write Size / Records:
3.5 MiB / 375916
Associated Job Ids:
7906
DAG Visualization
digraph G { subgraph clusterstage_16160 { label="Stage 16160"; subgraph cluster103672 { label="AQEShuffleRead"; 44296 [labelType="html" label="ShuffledRowRDD [44296] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103669 { label="WholeStageCodegen (4)"; 44297 [labelType="html" label="MapPartitionsRDD [44297] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103668 { label="Window"; 44298 [labelType="html" label="MapPartitionsRDD [44298] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103662 { label="WholeStageCodegen (5)"; 44299 [labelType="html" label="MapPartitionsRDD [44299] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103676 { label="AQEShuffleRead"; 44300 [labelType="html" label="ShuffledRowRDD [44300] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103673 { label="WholeStageCodegen (6)"; 44301 [labelType="html" label="MapPartitionsRDD [44301] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103661 { label="Union"; 44302 [labelType="html" label="UnionRDD [44302] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103660 { label="Exchange"; 44306 [labelType="html" label="MapPartitionsRDD [44306] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44296->44297; 44297->44298; 44298->44299; 44300->44301; 44299->44302; 44301->44302; 44302->44306; }
44285,44296
44295,44300
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time