3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 31872 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
30 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4045
Shuffle Write Size / Records:
143.0 B / 1
Associated Job Ids:
17617
DAG Visualization
digraph G { subgraph clusterstage_31872 { label="Stage 31872"; subgraph cluster203513 { label="AQEShuffleRead"; 88085 [labelType="html" label="ShuffledRowRDD [88085] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203510 { label="WholeStageCodegen (4)"; 88086 [labelType="html" label="MapPartitionsRDD [88086] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203518 { label="AQEShuffleRead"; 88087 [labelType="html" label="ShuffledRowRDD [88087] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203515 { label="WholeStageCodegen (5)"; 88088 [labelType="html" label="MapPartitionsRDD [88088] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203506 { label="WholeStageCodegen (6)"; 88089 [labelType="html" label="ZippedPartitionsRDD2 [88089] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 88090 [labelType="html" label="MapPartitionsRDD [88090] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203523 { label="AQEShuffleRead"; 88091 [labelType="html" label="ShuffledRowRDD [88091] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203520 { label="WholeStageCodegen (7)"; 88092 [labelType="html" label="MapPartitionsRDD [88092] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203502 { label="WholeStageCodegen (8)"; 88093 [labelType="html" label="ZippedPartitionsRDD2 [88093] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 88094 [labelType="html" label="MapPartitionsRDD [88094] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203501 { label="ObjectHashAggregate"; 88095 [labelType="html" label="MapPartitionsRDD [88095] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster203500 { label="Exchange"; 88096 [labelType="html" label="MapPartitionsRDD [88096] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 88085->88086; 88087->88088; 88086->88089; 88088->88089; 88089->88090; 88091->88092; 88090->88093; 88092->88093; 88093->88094; 88094->88095; 88095->88096; }
88076,88085
88080,88087
88084,88091
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time