3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7548 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1697.0 B / 21
Shuffle Write Size / Records:
937.0 B / 7
Associated Job Ids:
3659
DAG Visualization
digraph G { subgraph clusterstage_7548 { label="Stage 7548"; subgraph cluster47360 { label="AQEShuffleRead"; 20519 [labelType="html" label="ShuffledRowRDD [20519] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47357 { label="WholeStageCodegen (31)"; 20520 [labelType="html" label="MapPartitionsRDD [20520] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47365 { label="AQEShuffleRead"; 20521 [labelType="html" label="ShuffledRowRDD [20521] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47362 { label="WholeStageCodegen (32)"; 20522 [labelType="html" label="MapPartitionsRDD [20522] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47351 { label="WholeStageCodegen (33)"; 20523 [labelType="html" label="ZippedPartitionsRDD2 [20523] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20524 [labelType="html" label="MapPartitionsRDD [20524] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47370 { label="AQEShuffleRead"; 20525 [labelType="html" label="ShuffledRowRDD [20525] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47367 { label="WholeStageCodegen (34)"; 20526 [labelType="html" label="MapPartitionsRDD [20526] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47346 { label="WholeStageCodegen (35)"; 20527 [labelType="html" label="ZippedPartitionsRDD2 [20527] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20528 [labelType="html" label="MapPartitionsRDD [20528] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47345 { label="Exchange"; 20529 [labelType="html" label="MapPartitionsRDD [20529] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 20519->20520; 20521->20522; 20520->20523; 20522->20523; 20523->20524; 20525->20526; 20524->20527; 20526->20527; 20527->20528; 20528->20529; }
20518,20519
20466,20521
20470,20525
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time