3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 23016 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
365.3 KiB / 21591
Shuffle Write Size / Records:
297.0 KiB / 21131
Associated Job Ids:
11376
DAG Visualization
digraph G { subgraph clusterstage_23016 { label="Stage 23016"; subgraph cluster148491 { label="AQEShuffleRead"; 64627 [labelType="html" label="ShuffledRowRDD [64627] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148488 { label="WholeStageCodegen (9)"; 64628 [labelType="html" label="MapPartitionsRDD [64628] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148498 { label="AQEShuffleRead"; 64629 [labelType="html" label="ShuffledRowRDD [64629] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148497 { label="ObjectHashAggregate"; 64630 [labelType="html" label="MapPartitionsRDD [64630] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148493 { label="WholeStageCodegen (10)"; 64631 [labelType="html" label="MapPartitionsRDD [64631] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148483 { label="WholeStageCodegen (11)"; 64632 [labelType="html" label="ZippedPartitionsRDD2 [64632] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64633 [labelType="html" label="MapPartitionsRDD [64633] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148482 { label="Exchange"; 64634 [labelType="html" label="MapPartitionsRDD [64634] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64627->64628; 64629->64630; 64630->64631; 64628->64632; 64631->64632; 64632->64633; 64633->64634; }
64620,64627
64602,64629
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time