3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 23071 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
23 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
244.7 KiB / 21399
Shuffle Write Size / Records:
141.2 KiB / 21131
Associated Job Ids:
11399
DAG Visualization
digraph G { subgraph clusterstage_23071 { label="Stage 23071"; subgraph cluster148790 { label="AQEShuffleRead"; 64775 [labelType="html" label="ShuffledRowRDD [64775] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148787 { label="WholeStageCodegen (14)"; 64776 [labelType="html" label="MapPartitionsRDD [64776] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148795 { label="AQEShuffleRead"; 64777 [labelType="html" label="ShuffledRowRDD [64777] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148792 { label="WholeStageCodegen (15)"; 64778 [labelType="html" label="MapPartitionsRDD [64778] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148783 { label="WholeStageCodegen (16)"; 64779 [labelType="html" label="ZippedPartitionsRDD2 [64779] [Unordered]<br>count at ColumnStatJob.java:47"]; 64780 [labelType="html" label="MapPartitionsRDD [64780] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148782 { label="Exchange"; 64781 [labelType="html" label="MapPartitionsRDD [64781] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 64775->64776; 64777->64778; 64776->64779; 64778->64779; 64779->64780; 64780->64781; }
64774,64775
64762,64777
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time