3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15364 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
70 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
7766
DAG Visualization
digraph G { subgraph clusterstage_15364 { label="Stage 15364"; subgraph cluster100080 { label="AQEShuffleRead"; 42523 [labelType="html" label="ShuffledRowRDD [42523] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100077 { label="WholeStageCodegen (4)"; 42524 [labelType="html" label="MapPartitionsRDD [42524] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100085 { label="AQEShuffleRead"; 42525 [labelType="html" label="ShuffledRowRDD [42525] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100082 { label="WholeStageCodegen (5)"; 42526 [labelType="html" label="MapPartitionsRDD [42526] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100073 { label="WholeStageCodegen (6)"; 42527 [labelType="html" label="ZippedPartitionsRDD2 [42527] [Unordered]<br>count at ColumnStatJob.java:47"]; 42528 [labelType="html" label="MapPartitionsRDD [42528] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100090 { label="AQEShuffleRead"; 42529 [labelType="html" label="ShuffledRowRDD [42529] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100087 { label="WholeStageCodegen (7)"; 42530 [labelType="html" label="MapPartitionsRDD [42530] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100067 { label="WholeStageCodegen (8)"; 42531 [labelType="html" label="ZippedPartitionsRDD2 [42531] [Unordered]<br>count at ColumnStatJob.java:47"]; 42532 [labelType="html" label="MapPartitionsRDD [42532] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster100066 { label="Exchange"; 42533 [labelType="html" label="MapPartitionsRDD [42533] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 42523->42524; 42525->42526; 42524->42527; 42526->42527; 42527->42528; 42529->42530; 42528->42531; 42530->42531; 42531->42532; 42532->42533; }
42514,42523
42518,42525
42522,42529
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time