3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17542 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
137.8 KiB / 682827
Shuffle Write Size / Records:
144.0 B / 5
Associated Job Ids:
8589
DAG Visualization
digraph G { subgraph clusterstage_17542 { label="Stage 17542"; subgraph cluster112568 { label="AQEShuffleRead"; 47989 [labelType="html" label="ShuffledRowRDD [47989] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112565 { label="WholeStageCodegen (3)"; 47990 [labelType="html" label="MapPartitionsRDD [47990] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112573 { label="AQEShuffleRead"; 47991 [labelType="html" label="ShuffledRowRDD [47991] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112570 { label="WholeStageCodegen (4)"; 47992 [labelType="html" label="MapPartitionsRDD [47992] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112560 { label="WholeStageCodegen (5)"; 47993 [labelType="html" label="ZippedPartitionsRDD2 [47993] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 47994 [labelType="html" label="MapPartitionsRDD [47994] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112559 { label="Exchange"; 47995 [labelType="html" label="MapPartitionsRDD [47995] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 47989->47990; 47991->47992; 47990->47993; 47992->47993; 47993->47994; 47994->47995; }
47984,47989
47988,47991
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time