3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16638 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
69 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4045
Shuffle Write Size / Records:
147.0 B / 1
Associated Job Ids:
8730
DAG Visualization
digraph G { subgraph clusterstage_16638 { label="Stage 16638"; subgraph cluster107404 { label="AQEShuffleRead"; 45334 [labelType="html" label="ShuffledRowRDD [45334] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107401 { label="WholeStageCodegen (4)"; 45335 [labelType="html" label="MapPartitionsRDD [45335] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107409 { label="AQEShuffleRead"; 45336 [labelType="html" label="ShuffledRowRDD [45336] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107406 { label="WholeStageCodegen (5)"; 45337 [labelType="html" label="MapPartitionsRDD [45337] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107397 { label="WholeStageCodegen (6)"; 45338 [labelType="html" label="ZippedPartitionsRDD2 [45338] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 45339 [labelType="html" label="MapPartitionsRDD [45339] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107414 { label="AQEShuffleRead"; 45340 [labelType="html" label="ShuffledRowRDD [45340] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107411 { label="WholeStageCodegen (7)"; 45341 [labelType="html" label="MapPartitionsRDD [45341] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107393 { label="WholeStageCodegen (8)"; 45342 [labelType="html" label="ZippedPartitionsRDD2 [45342] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 45343 [labelType="html" label="MapPartitionsRDD [45343] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107392 { label="ObjectHashAggregate"; 45344 [labelType="html" label="MapPartitionsRDD [45344] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster107391 { label="Exchange"; 45345 [labelType="html" label="MapPartitionsRDD [45345] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 45334->45335; 45336->45337; 45335->45338; 45337->45338; 45338->45339; 45340->45341; 45339->45342; 45341->45342; 45342->45343; 45343->45344; 45344->45345; }
45325,45334
45329,45336
45333,45340
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time