3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10229 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.7 KiB / 284
Shuffle Write Size / Records:
793.0 B / 7
Associated Job Ids:
4513
DAG Visualization
digraph G { subgraph clusterstage_10229 { label="Stage 10229"; subgraph cluster60168 { label="AQEShuffleRead"; 25497 [labelType="html" label="ShuffledRowRDD [25497] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60165 { label="WholeStageCodegen (24)"; 25498 [labelType="html" label="MapPartitionsRDD [25498] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60173 { label="AQEShuffleRead"; 25499 [labelType="html" label="ShuffledRowRDD [25499] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60170 { label="WholeStageCodegen (25)"; 25500 [labelType="html" label="MapPartitionsRDD [25500] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60161 { label="WholeStageCodegen (26)"; 25501 [labelType="html" label="ZippedPartitionsRDD2 [25501] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 25502 [labelType="html" label="MapPartitionsRDD [25502] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60178 { label="AQEShuffleRead"; 25503 [labelType="html" label="ShuffledRowRDD [25503] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60175 { label="WholeStageCodegen (27)"; 25504 [labelType="html" label="MapPartitionsRDD [25504] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60157 { label="WholeStageCodegen (28)"; 25505 [labelType="html" label="ZippedPartitionsRDD2 [25505] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 25506 [labelType="html" label="MapPartitionsRDD [25506] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60183 { label="AQEShuffleRead"; 25507 [labelType="html" label="ShuffledRowRDD [25507] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60180 { label="WholeStageCodegen (29)"; 25508 [labelType="html" label="MapPartitionsRDD [25508] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60153 { label="WholeStageCodegen (30)"; 25509 [labelType="html" label="ZippedPartitionsRDD2 [25509] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 25510 [labelType="html" label="MapPartitionsRDD [25510] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster60152 { label="Exchange"; 25511 [labelType="html" label="MapPartitionsRDD [25511] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 25497->25498; 25499->25500; 25498->25501; 25500->25501; 25501->25502; 25503->25504; 25502->25505; 25504->25505; 25505->25506; 25507->25508; 25506->25509; 25508->25509; 25509->25510; 25510->25511; }
25496,25497
25444,25499
25448,25503
25455,25507
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time