3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15315 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
70 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
124.3 KiB / 10488
Shuffle Write Size / Records:
113.1 KiB / 6443
Associated Job Ids:
7741
DAG Visualization
digraph G { subgraph clusterstage_15315 { label="Stage 15315"; subgraph cluster99686 { label="AQEShuffleRead"; 42384 [labelType="html" label="ShuffledRowRDD [42384] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99683 { label="WholeStageCodegen (7)"; 42385 [labelType="html" label="MapPartitionsRDD [42385] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99691 { label="AQEShuffleRead"; 42386 [labelType="html" label="ShuffledRowRDD [42386] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99688 { label="WholeStageCodegen (8)"; 42387 [labelType="html" label="MapPartitionsRDD [42387] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99679 { label="WholeStageCodegen (9)"; 42388 [labelType="html" label="ZippedPartitionsRDD2 [42388] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42389 [labelType="html" label="MapPartitionsRDD [42389] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99696 { label="AQEShuffleRead"; 42390 [labelType="html" label="ShuffledRowRDD [42390] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99693 { label="WholeStageCodegen (10)"; 42391 [labelType="html" label="MapPartitionsRDD [42391] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99675 { label="WholeStageCodegen (11)"; 42392 [labelType="html" label="ZippedPartitionsRDD2 [42392] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 42393 [labelType="html" label="MapPartitionsRDD [42393] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99674 { label="ObjectHashAggregate"; 42394 [labelType="html" label="MapPartitionsRDD [42394] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99673 { label="Exchange"; 42395 [labelType="html" label="MapPartitionsRDD [42395] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42384->42385; 42386->42387; 42385->42388; 42387->42388; 42388->42389; 42390->42391; 42389->42392; 42391->42392; 42392->42393; 42393->42394; 42394->42395; }
42375,42384
42379,42386
42383,42390
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time