3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17449 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
16 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
166.0 MiB / 2368267
Shuffle Write Size / Records:
179.0 MiB / 2231123
Associated Job Ids:
9265
DAG Visualization
digraph G { subgraph clusterstage_17449 { label="Stage 17449"; subgraph cluster113627 { label="Exchange"; 48318 [labelType="html" label="ShuffledRowRDD [48318] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113623 { label="WholeStageCodegen (3)"; 48319 [labelType="html" label="MapPartitionsRDD [48319] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113638 { label="Exchange"; 48320 [labelType="html" label="ShuffledRowRDD [48320] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113634 { label="WholeStageCodegen (4)"; 48321 [labelType="html" label="MapPartitionsRDD [48321] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113633 { label="Window"; 48322 [labelType="html" label="MapPartitionsRDD [48322] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113629 { label="WholeStageCodegen (5)"; 48323 [labelType="html" label="MapPartitionsRDD [48323] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113619 { label="WholeStageCodegen (6)"; 48324 [labelType="html" label="ZippedPartitionsRDD2 [48324] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48325 [labelType="html" label="MapPartitionsRDD [48325] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113618 { label="Exchange"; 48326 [labelType="html" label="MapPartitionsRDD [48326] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48318->48319; 48320->48321; 48321->48322; 48322->48323; 48319->48324; 48323->48324; 48324->48325; 48325->48326; }
48310,48318
48314,48320
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time