3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9398 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1697.0 B / 21
Shuffle Write Size / Records:
937.0 B / 7
Associated Job Ids:
4256
DAG Visualization
digraph G { subgraph clusterstage_9398 { label="Stage 9398"; subgraph cluster56333 { label="AQEShuffleRead"; 24024 [labelType="html" label="ShuffledRowRDD [24024] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56330 { label="WholeStageCodegen (31)"; 24025 [labelType="html" label="MapPartitionsRDD [24025] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56338 { label="AQEShuffleRead"; 24026 [labelType="html" label="ShuffledRowRDD [24026] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56335 { label="WholeStageCodegen (32)"; 24027 [labelType="html" label="MapPartitionsRDD [24027] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56324 { label="WholeStageCodegen (33)"; 24028 [labelType="html" label="ZippedPartitionsRDD2 [24028] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24029 [labelType="html" label="MapPartitionsRDD [24029] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56343 { label="AQEShuffleRead"; 24030 [labelType="html" label="ShuffledRowRDD [24030] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56340 { label="WholeStageCodegen (34)"; 24031 [labelType="html" label="MapPartitionsRDD [24031] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56319 { label="WholeStageCodegen (35)"; 24032 [labelType="html" label="ZippedPartitionsRDD2 [24032] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24033 [labelType="html" label="MapPartitionsRDD [24033] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56318 { label="Exchange"; 24034 [labelType="html" label="MapPartitionsRDD [24034] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24024->24025; 24026->24027; 24025->24028; 24027->24028; 24028->24029; 24030->24031; 24029->24032; 24031->24032; 24032->24033; 24033->24034; }
24023,24024
23971,24026
23975,24030
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time