3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12289 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4046
Shuffle Write Size / Records:
142.0 B / 1
Associated Job Ids:
5289
DAG Visualization
digraph G { subgraph clusterstage_12289 { label="Stage 12289"; subgraph cluster71001 { label="AQEShuffleRead"; 29981 [labelType="html" label="ShuffledRowRDD [29981] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster70998 { label="WholeStageCodegen (4)"; 29982 [labelType="html" label="MapPartitionsRDD [29982] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71006 { label="AQEShuffleRead"; 29983 [labelType="html" label="ShuffledRowRDD [29983] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71003 { label="WholeStageCodegen (5)"; 29984 [labelType="html" label="MapPartitionsRDD [29984] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster70994 { label="WholeStageCodegen (6)"; 29985 [labelType="html" label="ZippedPartitionsRDD2 [29985] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 29986 [labelType="html" label="MapPartitionsRDD [29986] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71011 { label="AQEShuffleRead"; 29987 [labelType="html" label="ShuffledRowRDD [29987] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71008 { label="WholeStageCodegen (7)"; 29988 [labelType="html" label="MapPartitionsRDD [29988] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster70990 { label="WholeStageCodegen (8)"; 29989 [labelType="html" label="ZippedPartitionsRDD2 [29989] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 29990 [labelType="html" label="MapPartitionsRDD [29990] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster70989 { label="ObjectHashAggregate"; 29991 [labelType="html" label="MapPartitionsRDD [29991] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster70988 { label="Exchange"; 29992 [labelType="html" label="MapPartitionsRDD [29992] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 29981->29982; 29983->29984; 29982->29985; 29984->29985; 29985->29986; 29987->29988; 29986->29989; 29988->29989; 29989->29990; 29990->29991; 29991->29992; }
29972,29981
29976,29983
29980,29987
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time