3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7884 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.0 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.8 MiB / 415663
Associated Job Ids:
3861
DAG Visualization
digraph G { subgraph clusterstage_7884 { label="Stage 7884"; subgraph cluster51575 { label="AQEShuffleRead"; 22788 [labelType="html" label="ShuffledRowRDD [22788] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51572 { label="WholeStageCodegen (4)"; 22789 [labelType="html" label="MapPartitionsRDD [22789] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51571 { label="Window"; 22790 [labelType="html" label="MapPartitionsRDD [22790] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51565 { label="WholeStageCodegen (5)"; 22791 [labelType="html" label="MapPartitionsRDD [22791] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51579 { label="AQEShuffleRead"; 22792 [labelType="html" label="ShuffledRowRDD [22792] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51576 { label="WholeStageCodegen (6)"; 22793 [labelType="html" label="MapPartitionsRDD [22793] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51564 { label="Union"; 22794 [labelType="html" label="UnionRDD [22794] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51563 { label="Exchange"; 22795 [labelType="html" label="MapPartitionsRDD [22795] [Unordered]<br>rdd at PersistJob.java:28"]; 22796 [labelType="html" label="MapPartitionsRDD [22796] [Unordered]<br>rdd at PersistJob.java:28"]; 22797 [labelType="html" label="MapPartitionsRDD [22797] [Unordered]<br>rdd at PersistJob.java:28"]; } } 22788->22789; 22789->22790; 22790->22791; 22792->22793; 22791->22794; 22793->22794; 22794->22795; 22795->22796; 22796->22797; }
22777,22788
22787,22792
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time