3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21172 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
676.5 KiB / 21591
Shuffle Write Size / Records:
680.9 KiB / 21131
Associated Job Ids:
10615
DAG Visualization
digraph G { subgraph clusterstage_21172 { label="Stage 21172"; subgraph cluster138804 { label="AQEShuffleRead"; 60197 [labelType="html" label="ShuffledRowRDD [60197] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138801 { label="WholeStageCodegen (8)"; 60198 [labelType="html" label="MapPartitionsRDD [60198] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138811 { label="AQEShuffleRead"; 60199 [labelType="html" label="ShuffledRowRDD [60199] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138810 { label="ObjectHashAggregate"; 60200 [labelType="html" label="MapPartitionsRDD [60200] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138806 { label="WholeStageCodegen (9)"; 60201 [labelType="html" label="MapPartitionsRDD [60201] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138797 { label="WholeStageCodegen (10)"; 60202 [labelType="html" label="ZippedPartitionsRDD2 [60202] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 60203 [labelType="html" label="MapPartitionsRDD [60203] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster138796 { label="Exchange"; 60204 [labelType="html" label="MapPartitionsRDD [60204] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 60197->60198; 60199->60200; 60200->60201; 60198->60202; 60201->60202; 60202->60203; 60203->60204; }
60196,60197
60184,60199
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time