3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 23082 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
36 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
146.0 KiB / 21571
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
11400
DAG Visualization
digraph G { subgraph clusterstage_23082 { label="Stage 23082"; subgraph cluster148805 { label="AQEShuffleRead"; 64782 [labelType="html" label="ShuffledRowRDD [64782] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148802 { label="WholeStageCodegen (17)"; 64783 [labelType="html" label="MapPartitionsRDD [64783] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148810 { label="AQEShuffleRead"; 64784 [labelType="html" label="ShuffledRowRDD [64784] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148807 { label="WholeStageCodegen (18)"; 64785 [labelType="html" label="MapPartitionsRDD [64785] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148797 { label="WholeStageCodegen (19)"; 64786 [labelType="html" label="ZippedPartitionsRDD2 [64786] [Unordered]<br>count at ColumnStatJob.java:47"]; 64787 [labelType="html" label="MapPartitionsRDD [64787] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster148796 { label="Exchange"; 64788 [labelType="html" label="MapPartitionsRDD [64788] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 64782->64783; 64784->64785; 64783->64786; 64785->64786; 64786->64787; 64787->64788; }
64781,64782
64766,64784
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time