3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15254 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
113.1 KiB / 6443
Associated Job Ids:
7710
DAG Visualization
digraph G { subgraph clusterstage_15254 { label="Stage 15254"; subgraph cluster99229 { label="AQEShuffleRead"; 42184 [labelType="html" label="ShuffledRowRDD [42184] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99226 { label="WholeStageCodegen (7)"; 42185 [labelType="html" label="MapPartitionsRDD [42185] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99234 { label="AQEShuffleRead"; 42186 [labelType="html" label="ShuffledRowRDD [42186] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99231 { label="WholeStageCodegen (8)"; 42187 [labelType="html" label="MapPartitionsRDD [42187] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99222 { label="WholeStageCodegen (9)"; 42188 [labelType="html" label="ZippedPartitionsRDD2 [42188] [Unordered]<br>count at ColumnStatJob.java:47"]; 42189 [labelType="html" label="MapPartitionsRDD [42189] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99239 { label="AQEShuffleRead"; 42190 [labelType="html" label="ShuffledRowRDD [42190] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99236 { label="WholeStageCodegen (10)"; 42191 [labelType="html" label="MapPartitionsRDD [42191] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99218 { label="WholeStageCodegen (11)"; 42192 [labelType="html" label="ZippedPartitionsRDD2 [42192] [Unordered]<br>count at ColumnStatJob.java:47"]; 42193 [labelType="html" label="MapPartitionsRDD [42193] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99217 { label="ObjectHashAggregate"; 42194 [labelType="html" label="MapPartitionsRDD [42194] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99216 { label="Exchange"; 42195 [labelType="html" label="MapPartitionsRDD [42195] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 42184->42185; 42186->42187; 42185->42188; 42187->42188; 42188->42189; 42190->42191; 42189->42192; 42191->42192; 42192->42193; 42193->42194; 42194->42195; }
42175,42184
42179,42186
42183,42190
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time