3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7888 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.8 MiB / 415663
Shuffle Write Size / Records:
5.7 MiB / 568241
Associated Job Ids:
3862
DAG Visualization
digraph G { subgraph clusterstage_7888 { label="Stage 7888"; subgraph cluster51575 { label="AQEShuffleRead"; 22788 [labelType="html" label="ShuffledRowRDD [22788] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51572 { label="WholeStageCodegen (4)"; 22789 [labelType="html" label="MapPartitionsRDD [22789] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51571 { label="Window"; 22790 [labelType="html" label="MapPartitionsRDD [22790] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51565 { label="WholeStageCodegen (5)"; 22791 [labelType="html" label="MapPartitionsRDD [22791] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51579 { label="AQEShuffleRead"; 22792 [labelType="html" label="ShuffledRowRDD [22792] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51576 { label="WholeStageCodegen (6)"; 22793 [labelType="html" label="MapPartitionsRDD [22793] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51564 { label="Union"; 22794 [labelType="html" label="UnionRDD [22794] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51563 { label="Exchange"; 22798 [labelType="html" label="MapPartitionsRDD [22798] [Unordered]<br>rdd at PersistJob.java:28"]; } } 22788->22789; 22789->22790; 22790->22791; 22792->22793; 22791->22794; 22793->22794; 22794->22798; }
22777,22788
22787,22792
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time