3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15378 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
77 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Associated Job Ids:
7773
DAG Visualization
digraph G { subgraph clusterstage_15378 { label="Stage 15378"; subgraph cluster100166 { label="AQEShuffleRead"; 42553 [labelType="html" label="ShuffledRowRDD [42553] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100163 { label="WholeStageCodegen (4)"; 42554 [labelType="html" label="MapPartitionsRDD [42554] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100171 { label="AQEShuffleRead"; 42555 [labelType="html" label="ShuffledRowRDD [42555] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100168 { label="WholeStageCodegen (5)"; 42556 [labelType="html" label="MapPartitionsRDD [42556] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100159 { label="WholeStageCodegen (6)"; 42557 [labelType="html" label="ZippedPartitionsRDD2 [42557] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42558 [labelType="html" label="MapPartitionsRDD [42558] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100176 { label="AQEShuffleRead"; 42559 [labelType="html" label="ShuffledRowRDD [42559] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100173 { label="WholeStageCodegen (7)"; 42560 [labelType="html" label="MapPartitionsRDD [42560] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100154 { label="WholeStageCodegen (8)"; 42561 [labelType="html" label="ZippedPartitionsRDD2 [42561] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42562 [labelType="html" label="MapPartitionsRDD [42562] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100177 { label="mapPartitionsInternal"; 42563 [labelType="html" label="MapPartitionsRDD [42563] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42553->42554; 42555->42556; 42554->42557; 42556->42557; 42557->42558; 42559->42560; 42558->42561; 42560->42561; 42561->42562; 42562->42563; }
42544,42553
42548,42555
42552,42559
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time