3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20863 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
429.0 KiB / 21566
Shuffle Write Size / Records:
340.1 KiB / 21127
Associated Job Ids:
10446
DAG Visualization
digraph G { subgraph clusterstage_20863 { label="Stage 20863"; subgraph cluster136902 { label="AQEShuffleRead"; 59324 [labelType="html" label="ShuffledRowRDD [59324] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136899 { label="WholeStageCodegen (4)"; 59325 [labelType="html" label="MapPartitionsRDD [59325] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136908 { label="AQEShuffleRead"; 59326 [labelType="html" label="ShuffledRowRDD [59326] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136904 { label="WholeStageCodegen (5)"; 59327 [labelType="html" label="MapPartitionsRDD [59327] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136895 { label="WholeStageCodegen (6)"; 59328 [labelType="html" label="ZippedPartitionsRDD2 [59328] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59329 [labelType="html" label="MapPartitionsRDD [59329] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster136894 { label="Exchange"; 59330 [labelType="html" label="MapPartitionsRDD [59330] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59324->59325; 59326->59327; 59325->59328; 59327->59328; 59328->59329; 59329->59330; }
59315,59324
59319,59326
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time