3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7680 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.7 KiB / 284
Shuffle Write Size / Records:
793.0 B / 7
Associated Job Ids:
3708
DAG Visualization
digraph G { subgraph clusterstage_7680 { label="Stage 7680"; subgraph cluster48074 { label="AQEShuffleRead"; 20793 [labelType="html" label="ShuffledRowRDD [20793] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48071 { label="WholeStageCodegen (24)"; 20794 [labelType="html" label="MapPartitionsRDD [20794] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48079 { label="AQEShuffleRead"; 20795 [labelType="html" label="ShuffledRowRDD [20795] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48076 { label="WholeStageCodegen (25)"; 20796 [labelType="html" label="MapPartitionsRDD [20796] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48067 { label="WholeStageCodegen (26)"; 20797 [labelType="html" label="ZippedPartitionsRDD2 [20797] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20798 [labelType="html" label="MapPartitionsRDD [20798] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48084 { label="AQEShuffleRead"; 20799 [labelType="html" label="ShuffledRowRDD [20799] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48081 { label="WholeStageCodegen (27)"; 20800 [labelType="html" label="MapPartitionsRDD [20800] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48063 { label="WholeStageCodegen (28)"; 20801 [labelType="html" label="ZippedPartitionsRDD2 [20801] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20802 [labelType="html" label="MapPartitionsRDD [20802] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48089 { label="AQEShuffleRead"; 20803 [labelType="html" label="ShuffledRowRDD [20803] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48086 { label="WholeStageCodegen (29)"; 20804 [labelType="html" label="MapPartitionsRDD [20804] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48059 { label="WholeStageCodegen (30)"; 20805 [labelType="html" label="ZippedPartitionsRDD2 [20805] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20806 [labelType="html" label="MapPartitionsRDD [20806] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster48058 { label="Exchange"; 20807 [labelType="html" label="MapPartitionsRDD [20807] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 20793->20794; 20795->20796; 20794->20797; 20796->20797; 20797->20798; 20799->20800; 20798->20801; 20800->20801; 20801->20802; 20803->20804; 20802->20805; 20804->20805; 20805->20806; 20806->20807; }
20792,20793
20743,20795
20747,20799
20751,20803
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time