3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13483 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4046
Shuffle Write Size / Records:
148.0 B / 1
Associated Job Ids:
5977
DAG Visualization
digraph G { subgraph clusterstage_13483 { label="Stage 13483"; subgraph cluster79020 { label="AQEShuffleRead"; 33412 [labelType="html" label="ShuffledRowRDD [33412] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79017 { label="WholeStageCodegen (4)"; 33413 [labelType="html" label="MapPartitionsRDD [33413] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79025 { label="AQEShuffleRead"; 33414 [labelType="html" label="ShuffledRowRDD [33414] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79022 { label="WholeStageCodegen (5)"; 33415 [labelType="html" label="MapPartitionsRDD [33415] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79013 { label="WholeStageCodegen (6)"; 33416 [labelType="html" label="ZippedPartitionsRDD2 [33416] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 33417 [labelType="html" label="MapPartitionsRDD [33417] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79030 { label="AQEShuffleRead"; 33418 [labelType="html" label="ShuffledRowRDD [33418] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79027 { label="WholeStageCodegen (7)"; 33419 [labelType="html" label="MapPartitionsRDD [33419] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79009 { label="WholeStageCodegen (8)"; 33420 [labelType="html" label="ZippedPartitionsRDD2 [33420] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 33421 [labelType="html" label="MapPartitionsRDD [33421] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79008 { label="ObjectHashAggregate"; 33422 [labelType="html" label="MapPartitionsRDD [33422] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster79007 { label="Exchange"; 33423 [labelType="html" label="MapPartitionsRDD [33423] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 33412->33413; 33414->33415; 33413->33416; 33415->33416; 33416->33417; 33418->33419; 33417->33420; 33419->33420; 33420->33421; 33421->33422; 33422->33423; }
33403,33412
33407,33414
33411,33418
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time