3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20868 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
345.1 KiB / 21591
Shuffle Write Size / Records:
149.0 B / 1
Associated Job Ids:
10447
DAG Visualization
digraph G { subgraph clusterstage_20868 { label="Stage 20868"; subgraph cluster136918 { label="AQEShuffleRead"; 59331 [labelType="html" label="ShuffledRowRDD [59331] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136915 { label="WholeStageCodegen (7)"; 59332 [labelType="html" label="MapPartitionsRDD [59332] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136924 { label="AQEShuffleRead"; 59333 [labelType="html" label="ShuffledRowRDD [59333] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136920 { label="WholeStageCodegen (8)"; 59334 [labelType="html" label="MapPartitionsRDD [59334] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136911 { label="WholeStageCodegen (9)"; 59335 [labelType="html" label="ZippedPartitionsRDD2 [59335] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59336 [labelType="html" label="MapPartitionsRDD [59336] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136910 { label="SortAggregate"; 59337 [labelType="html" label="MapPartitionsRDD [59337] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136909 { label="Exchange"; 59338 [labelType="html" label="MapPartitionsRDD [59338] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59331->59332; 59333->59334; 59332->59335; 59334->59335; 59335->59336; 59336->59337; 59337->59338; }
59330,59331
59323,59333
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time