3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15256 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 4
Shuffle Read Size / Records:
4.2 MiB / 285629
Shuffle Write Size / Records:
3.5 MiB / 377497
Associated Job Ids:
8039
DAG Visualization
digraph G { subgraph clusterstage_15256 { label="Stage 15256"; subgraph cluster98680 { label="AQEShuffleRead"; 41685 [labelType="html" label="ShuffledRowRDD [41685] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98677 { label="WholeStageCodegen (4)"; 41686 [labelType="html" label="MapPartitionsRDD [41686] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98676 { label="Window"; 41687 [labelType="html" label="MapPartitionsRDD [41687] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98670 { label="WholeStageCodegen (5)"; 41688 [labelType="html" label="MapPartitionsRDD [41688] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98684 { label="AQEShuffleRead"; 41689 [labelType="html" label="ShuffledRowRDD [41689] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98681 { label="WholeStageCodegen (6)"; 41690 [labelType="html" label="MapPartitionsRDD [41690] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98669 { label="Union"; 41691 [labelType="html" label="UnionRDD [41691] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster98668 { label="Exchange"; 41695 [labelType="html" label="MapPartitionsRDD [41695] [Unordered]<br>rdd at PersistJob.java:28"]; } } 41685->41686; 41686->41687; 41687->41688; 41689->41690; 41688->41691; 41690->41691; 41691->41695; }
41674,41685
41684,41689
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time