3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 22913 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
422.2 KiB / 21566
Shuffle Write Size / Records:
356.2 KiB / 21127
Associated Job Ids:
11339
DAG Visualization
digraph G { subgraph clusterstage_22913 { label="Stage 22913"; subgraph cluster148019 { label="AQEShuffleRead"; 64411 [labelType="html" label="ShuffledRowRDD [64411] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148016 { label="WholeStageCodegen (6)"; 64412 [labelType="html" label="MapPartitionsRDD [64412] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148026 { label="AQEShuffleRead"; 64413 [labelType="html" label="ShuffledRowRDD [64413] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148025 { label="ObjectHashAggregate"; 64414 [labelType="html" label="MapPartitionsRDD [64414] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148021 { label="WholeStageCodegen (7)"; 64415 [labelType="html" label="MapPartitionsRDD [64415] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148012 { label="WholeStageCodegen (8)"; 64416 [labelType="html" label="ZippedPartitionsRDD2 [64416] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 64417 [labelType="html" label="MapPartitionsRDD [64417] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster148011 { label="Exchange"; 64418 [labelType="html" label="MapPartitionsRDD [64418] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 64411->64412; 64413->64414; 64414->64415; 64412->64416; 64415->64416; 64416->64417; 64417->64418; }
64387,64411
64392,64413
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time