3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5600 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
62 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4046
Shuffle Write Size / Records:
140.0 B / 1
Associated Job Ids:
3005
DAG Visualization
digraph G { subgraph clusterstage_5600 { label="Stage 5600"; subgraph cluster35180 { label="AQEShuffleRead"; 14568 [labelType="html" label="ShuffledRowRDD [14568] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35177 { label="WholeStageCodegen (4)"; 14569 [labelType="html" label="MapPartitionsRDD [14569] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35185 { label="AQEShuffleRead"; 14570 [labelType="html" label="ShuffledRowRDD [14570] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35182 { label="WholeStageCodegen (5)"; 14571 [labelType="html" label="MapPartitionsRDD [14571] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35173 { label="WholeStageCodegen (6)"; 14572 [labelType="html" label="ZippedPartitionsRDD2 [14572] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 14573 [labelType="html" label="MapPartitionsRDD [14573] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35190 { label="AQEShuffleRead"; 14574 [labelType="html" label="ShuffledRowRDD [14574] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35187 { label="WholeStageCodegen (7)"; 14575 [labelType="html" label="MapPartitionsRDD [14575] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35169 { label="WholeStageCodegen (8)"; 14576 [labelType="html" label="ZippedPartitionsRDD2 [14576] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 14577 [labelType="html" label="MapPartitionsRDD [14577] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35168 { label="ObjectHashAggregate"; 14578 [labelType="html" label="MapPartitionsRDD [14578] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35167 { label="Exchange"; 14579 [labelType="html" label="MapPartitionsRDD [14579] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 14568->14569; 14570->14571; 14569->14572; 14571->14572; 14572->14573; 14574->14575; 14573->14576; 14575->14576; 14576->14577; 14577->14578; 14578->14579; }
14559,14568
14563,14570
14567,14574
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time