3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21221 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
72 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
781.7 KiB / 21566
Shuffle Write Size / Records:
667.4 KiB / 21127
Associated Job Ids:
10637
DAG Visualization
digraph G { subgraph clusterstage_21221 { label="Stage 21221"; subgraph cluster139127 { label="AQEShuffleRead"; 60354 [labelType="html" label="ShuffledRowRDD [60354] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139124 { label="WholeStageCodegen (5)"; 60355 [labelType="html" label="MapPartitionsRDD [60355] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139134 { label="AQEShuffleRead"; 60356 [labelType="html" label="ShuffledRowRDD [60356] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139133 { label="ObjectHashAggregate"; 60357 [labelType="html" label="MapPartitionsRDD [60357] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139129 { label="WholeStageCodegen (6)"; 60358 [labelType="html" label="MapPartitionsRDD [60358] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139120 { label="WholeStageCodegen (7)"; 60359 [labelType="html" label="ZippedPartitionsRDD2 [60359] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 60360 [labelType="html" label="MapPartitionsRDD [60360] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster139119 { label="Exchange"; 60361 [labelType="html" label="MapPartitionsRDD [60361] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 60354->60355; 60356->60357; 60357->60358; 60355->60359; 60358->60359; 60359->60360; 60360->60361; }
60339,60354
60344,60356
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time