3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 31469 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
302.1 KiB / 1500476
Shuffle Write Size / Records:
146.0 B / 5
Associated Job Ids:
17318
DAG Visualization
digraph G { subgraph clusterstage_31469 { label="Stage 31469"; subgraph cluster200938 { label="AQEShuffleRead"; 87070 [labelType="html" label="ShuffledRowRDD [87070] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200935 { label="WholeStageCodegen (3)"; 87071 [labelType="html" label="MapPartitionsRDD [87071] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200943 { label="AQEShuffleRead"; 87072 [labelType="html" label="ShuffledRowRDD [87072] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200940 { label="WholeStageCodegen (4)"; 87073 [labelType="html" label="MapPartitionsRDD [87073] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200930 { label="WholeStageCodegen (5)"; 87074 [labelType="html" label="ZippedPartitionsRDD2 [87074] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 87075 [labelType="html" label="MapPartitionsRDD [87075] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster200929 { label="Exchange"; 87076 [labelType="html" label="MapPartitionsRDD [87076] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 87070->87071; 87072->87073; 87071->87074; 87073->87074; 87074->87075; 87075->87076; }
87065,87070
87069,87072
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time