3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7534 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.7 KiB / 284
Shuffle Write Size / Records:
793.0 B / 7
Associated Job Ids:
3658
DAG Visualization
digraph G { subgraph clusterstage_7534 { label="Stage 7534"; subgraph cluster47329 { label="AQEShuffleRead"; 20504 [labelType="html" label="ShuffledRowRDD [20504] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47326 { label="WholeStageCodegen (24)"; 20505 [labelType="html" label="MapPartitionsRDD [20505] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47334 { label="AQEShuffleRead"; 20506 [labelType="html" label="ShuffledRowRDD [20506] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47331 { label="WholeStageCodegen (25)"; 20507 [labelType="html" label="MapPartitionsRDD [20507] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47322 { label="WholeStageCodegen (26)"; 20508 [labelType="html" label="ZippedPartitionsRDD2 [20508] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20509 [labelType="html" label="MapPartitionsRDD [20509] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47339 { label="AQEShuffleRead"; 20510 [labelType="html" label="ShuffledRowRDD [20510] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47336 { label="WholeStageCodegen (27)"; 20511 [labelType="html" label="MapPartitionsRDD [20511] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47318 { label="WholeStageCodegen (28)"; 20512 [labelType="html" label="ZippedPartitionsRDD2 [20512] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20513 [labelType="html" label="MapPartitionsRDD [20513] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47344 { label="AQEShuffleRead"; 20514 [labelType="html" label="ShuffledRowRDD [20514] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47341 { label="WholeStageCodegen (29)"; 20515 [labelType="html" label="MapPartitionsRDD [20515] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47314 { label="WholeStageCodegen (30)"; 20516 [labelType="html" label="ZippedPartitionsRDD2 [20516] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 20517 [labelType="html" label="MapPartitionsRDD [20517] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster47313 { label="Exchange"; 20518 [labelType="html" label="MapPartitionsRDD [20518] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 20504->20505; 20506->20507; 20505->20508; 20507->20508; 20508->20509; 20510->20511; 20509->20512; 20511->20512; 20512->20513; 20514->20515; 20513->20516; 20515->20516; 20516->20517; 20517->20518; }
20503,20504
20454,20506
20458,20510
20462,20514
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time