3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20884 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
53 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
429.0 KiB / 21566
Shuffle Write Size / Records:
340.1 KiB / 21127
Associated Job Ids:
10456
DAG Visualization
digraph G { subgraph clusterstage_20884 { label="Stage 20884"; subgraph cluster137037 { label="AQEShuffleRead"; 59394 [labelType="html" label="ShuffledRowRDD [59394] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137034 { label="WholeStageCodegen (4)"; 59395 [labelType="html" label="MapPartitionsRDD [59395] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137043 { label="AQEShuffleRead"; 59396 [labelType="html" label="ShuffledRowRDD [59396] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137039 { label="WholeStageCodegen (5)"; 59397 [labelType="html" label="MapPartitionsRDD [59397] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137030 { label="WholeStageCodegen (6)"; 59398 [labelType="html" label="ZippedPartitionsRDD2 [59398] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59399 [labelType="html" label="MapPartitionsRDD [59399] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137029 { label="Exchange"; 59400 [labelType="html" label="MapPartitionsRDD [59400] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59394->59395; 59396->59397; 59395->59398; 59397->59398; 59398->59399; 59399->59400; }
59385,59394
59389,59396
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time