3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 23007 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
422.2 KiB / 21566
Shuffle Write Size / Records:
356.2 KiB / 21127
Associated Job Ids:
11373
DAG Visualization
digraph G { subgraph clusterstage_23007 { label="Stage 23007"; subgraph cluster148468 { label="AQEShuffleRead"; 64613 [labelType="html" label="ShuffledRowRDD [64613] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148465 { label="WholeStageCodegen (6)"; 64614 [labelType="html" label="MapPartitionsRDD [64614] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148475 { label="AQEShuffleRead"; 64615 [labelType="html" label="ShuffledRowRDD [64615] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148474 { label="ObjectHashAggregate"; 64616 [labelType="html" label="MapPartitionsRDD [64616] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148470 { label="WholeStageCodegen (7)"; 64617 [labelType="html" label="MapPartitionsRDD [64617] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148461 { label="WholeStageCodegen (8)"; 64618 [labelType="html" label="ZippedPartitionsRDD2 [64618] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64619 [labelType="html" label="MapPartitionsRDD [64619] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148460 { label="Exchange"; 64620 [labelType="html" label="MapPartitionsRDD [64620] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64613->64614; 64615->64616; 64616->64617; 64614->64618; 64617->64618; 64618->64619; 64619->64620; }
64592,64613
64597,64615
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time