3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21033 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
99 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
781.7 KiB / 21566
Shuffle Write Size / Records:
667.4 KiB / 21127
Associated Job Ids:
10522
DAG Visualization
digraph G { subgraph clusterstage_21033 { label="Stage 21033"; subgraph cluster137954 { label="AQEShuffleRead"; 59851 [labelType="html" label="ShuffledRowRDD [59851] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137951 { label="WholeStageCodegen (5)"; 59852 [labelType="html" label="MapPartitionsRDD [59852] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137961 { label="AQEShuffleRead"; 59853 [labelType="html" label="ShuffledRowRDD [59853] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137960 { label="ObjectHashAggregate"; 59854 [labelType="html" label="MapPartitionsRDD [59854] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137956 { label="WholeStageCodegen (6)"; 59855 [labelType="html" label="MapPartitionsRDD [59855] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137947 { label="WholeStageCodegen (7)"; 59856 [labelType="html" label="ZippedPartitionsRDD2 [59856] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59857 [labelType="html" label="MapPartitionsRDD [59857] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137946 { label="Exchange"; 59858 [labelType="html" label="MapPartitionsRDD [59858] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59851->59852; 59853->59854; 59854->59855; 59852->59856; 59855->59856; 59856->59857; 59857->59858; }
59836,59851
59841,59853
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time