3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8444 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
178.3 KiB / 884780
Shuffle Write Size / Records:
144.0 B / 5
Associated Job Ids:
4194
DAG Visualization
digraph G { subgraph clusterstage_8444 { label="Stage 8444"; subgraph cluster55350 { label="AQEShuffleRead"; 24295 [labelType="html" label="ShuffledRowRDD [24295] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55347 { label="WholeStageCodegen (3)"; 24296 [labelType="html" label="MapPartitionsRDD [24296] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55355 { label="AQEShuffleRead"; 24297 [labelType="html" label="ShuffledRowRDD [24297] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55352 { label="WholeStageCodegen (4)"; 24298 [labelType="html" label="MapPartitionsRDD [24298] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55342 { label="WholeStageCodegen (5)"; 24299 [labelType="html" label="ZippedPartitionsRDD2 [24299] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24300 [labelType="html" label="MapPartitionsRDD [24300] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster55341 { label="Exchange"; 24301 [labelType="html" label="MapPartitionsRDD [24301] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24295->24296; 24297->24298; 24296->24299; 24298->24299; 24299->24300; 24300->24301; }
24290,24295
24294,24297
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time