3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16391 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
120.7 KiB / 597671
Shuffle Write Size / Records:
146.0 B / 5
Associated Job Ids:
8017
DAG Visualization
digraph G { subgraph clusterstage_16391 { label="Stage 16391"; subgraph cluster105092 { label="AQEShuffleRead"; 44845 [labelType="html" label="ShuffledRowRDD [44845] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster105089 { label="WholeStageCodegen (3)"; 44846 [labelType="html" label="MapPartitionsRDD [44846] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster105097 { label="AQEShuffleRead"; 44847 [labelType="html" label="ShuffledRowRDD [44847] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster105094 { label="WholeStageCodegen (4)"; 44848 [labelType="html" label="MapPartitionsRDD [44848] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster105084 { label="WholeStageCodegen (5)"; 44849 [labelType="html" label="ZippedPartitionsRDD2 [44849] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 44850 [labelType="html" label="MapPartitionsRDD [44850] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster105083 { label="Exchange"; 44851 [labelType="html" label="MapPartitionsRDD [44851] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 44845->44846; 44847->44848; 44846->44849; 44848->44849; 44849->44850; 44850->44851; }
44840,44845
44844,44847
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time