3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 20932 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
92 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
676.5 KiB / 21591
Shuffle Write Size / Records:
51.5 KiB / 1500
Associated Job Ids:
10478
DAG Visualization
digraph G { subgraph clusterstage_20932 { label="Stage 20932"; subgraph cluster137333 { label="AQEShuffleRead"; 59547 [labelType="html" label="ShuffledRowRDD [59547] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137330 { label="WholeStageCodegen (8)"; 59548 [labelType="html" label="MapPartitionsRDD [59548] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137340 { label="AQEShuffleRead"; 59549 [labelType="html" label="ShuffledRowRDD [59549] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137339 { label="ObjectHashAggregate"; 59550 [labelType="html" label="MapPartitionsRDD [59550] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137335 { label="WholeStageCodegen (9)"; 59551 [labelType="html" label="MapPartitionsRDD [59551] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137325 { label="WholeStageCodegen (10)"; 59552 [labelType="html" label="ZippedPartitionsRDD2 [59552] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 59553 [labelType="html" label="MapPartitionsRDD [59553] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster137324 { label="Exchange"; 59554 [labelType="html" label="MapPartitionsRDD [59554] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 59547->59548; 59549->59550; 59550->59551; 59548->59552; 59551->59552; 59552->59553; 59553->59554; }
59546,59547
59534,59549
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time