3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15605 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
171.3 KiB / 850105
Shuffle Write Size / Records:
144.0 B / 5
Associated Job Ids:
8228
DAG Visualization
digraph G { subgraph clusterstage_15605 { label="Stage 15605"; subgraph cluster100871 { label="AQEShuffleRead"; 42538 [labelType="html" label="ShuffledRowRDD [42538] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100868 { label="WholeStageCodegen (3)"; 42539 [labelType="html" label="MapPartitionsRDD [42539] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100876 { label="AQEShuffleRead"; 42540 [labelType="html" label="ShuffledRowRDD [42540] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100873 { label="WholeStageCodegen (4)"; 42541 [labelType="html" label="MapPartitionsRDD [42541] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100863 { label="WholeStageCodegen (5)"; 42542 [labelType="html" label="ZippedPartitionsRDD2 [42542] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42543 [labelType="html" label="MapPartitionsRDD [42543] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster100862 { label="Exchange"; 42544 [labelType="html" label="MapPartitionsRDD [42544] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42538->42539; 42540->42541; 42539->42542; 42541->42542; 42542->42543; 42543->42544; }
42533,42538
42537,42540
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time