3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10243 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1697.0 B / 21
Shuffle Write Size / Records:
937.0 B / 7
Associated Job Ids:
4514
DAG Visualization
digraph G { subgraph clusterstage_10243 { label="Stage 10243"; subgraph cluster60199 { label="AQEShuffleRead"; 25512 [labelType="html" label="ShuffledRowRDD [25512] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60196 { label="WholeStageCodegen (31)"; 25513 [labelType="html" label="MapPartitionsRDD [25513] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60204 { label="AQEShuffleRead"; 25514 [labelType="html" label="ShuffledRowRDD [25514] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60201 { label="WholeStageCodegen (32)"; 25515 [labelType="html" label="MapPartitionsRDD [25515] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60190 { label="WholeStageCodegen (33)"; 25516 [labelType="html" label="ZippedPartitionsRDD2 [25516] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 25517 [labelType="html" label="MapPartitionsRDD [25517] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60209 { label="AQEShuffleRead"; 25518 [labelType="html" label="ShuffledRowRDD [25518] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60206 { label="WholeStageCodegen (34)"; 25519 [labelType="html" label="MapPartitionsRDD [25519] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60185 { label="WholeStageCodegen (35)"; 25520 [labelType="html" label="ZippedPartitionsRDD2 [25520] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 25521 [labelType="html" label="MapPartitionsRDD [25521] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60184 { label="Exchange"; 25522 [labelType="html" label="MapPartitionsRDD [25522] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 25512->25513; 25514->25515; 25513->25516; 25515->25516; 25516->25517; 25518->25519; 25517->25520; 25519->25520; 25520->25521; 25521->25522; }
25511,25512
25459,25514
25463,25518
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time