3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15301 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
47 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
113.1 KiB / 6443
Associated Job Ids:
7735
DAG Visualization
digraph G { subgraph clusterstage_15301 { label="Stage 15301"; subgraph cluster99599 { label="AQEShuffleRead"; 42340 [labelType="html" label="ShuffledRowRDD [42340] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99596 { label="WholeStageCodegen (7)"; 42341 [labelType="html" label="MapPartitionsRDD [42341] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99606 { label="AQEShuffleRead"; 42342 [labelType="html" label="ShuffledRowRDD [42342] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99603 { label="WholeStageCodegen (8)"; 42343 [labelType="html" label="MapPartitionsRDD [42343] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99592 { label="WholeStageCodegen (9)"; 42344 [labelType="html" label="ZippedPartitionsRDD2 [42344] [Unordered]<br>count at ColumnStatJob.java:47"]; 42345 [labelType="html" label="MapPartitionsRDD [42345] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99611 { label="AQEShuffleRead"; 42346 [labelType="html" label="ShuffledRowRDD [42346] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99608 { label="WholeStageCodegen (10)"; 42347 [labelType="html" label="MapPartitionsRDD [42347] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99588 { label="WholeStageCodegen (11)"; 42348 [labelType="html" label="ZippedPartitionsRDD2 [42348] [Unordered]<br>count at ColumnStatJob.java:47"]; 42349 [labelType="html" label="MapPartitionsRDD [42349] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99587 { label="ObjectHashAggregate"; 42350 [labelType="html" label="MapPartitionsRDD [42350] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99586 { label="Exchange"; 42351 [labelType="html" label="MapPartitionsRDD [42351] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 42340->42341; 42342->42343; 42341->42344; 42343->42344; 42344->42345; 42346->42347; 42345->42348; 42347->42348; 42348->42349; 42349->42350; 42350->42351; }
42319,42340
42323,42342
42331,42346
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time