3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5162 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
52.3 KiB / 257662
Shuffle Write Size / Records:
120.0 B / 5
Associated Job Ids:
2667
DAG Visualization
digraph G { subgraph clusterstage_5162 { label="Stage 5162"; subgraph cluster33688 { label="AQEShuffleRead"; 14616 [labelType="html" label="ShuffledRowRDD [14616] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster33685 { label="WholeStageCodegen (3)"; 14617 [labelType="html" label="MapPartitionsRDD [14617] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster33693 { label="AQEShuffleRead"; 14618 [labelType="html" label="ShuffledRowRDD [14618] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster33690 { label="WholeStageCodegen (4)"; 14619 [labelType="html" label="MapPartitionsRDD [14619] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster33680 { label="WholeStageCodegen (5)"; 14620 [labelType="html" label="ZippedPartitionsRDD2 [14620] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 14621 [labelType="html" label="MapPartitionsRDD [14621] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster33679 { label="Exchange"; 14622 [labelType="html" label="MapPartitionsRDD [14622] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 14616->14617; 14618->14619; 14617->14620; 14619->14620; 14620->14621; 14621->14622; }
14611,14616
14615,14618
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time