3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9384 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.7 KiB / 284
Shuffle Write Size / Records:
793.0 B / 7
Associated Job Ids:
4255
DAG Visualization
digraph G { subgraph clusterstage_9384 { label="Stage 9384"; subgraph cluster56302 { label="AQEShuffleRead"; 24009 [labelType="html" label="ShuffledRowRDD [24009] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56299 { label="WholeStageCodegen (24)"; 24010 [labelType="html" label="MapPartitionsRDD [24010] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56307 { label="AQEShuffleRead"; 24011 [labelType="html" label="ShuffledRowRDD [24011] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56304 { label="WholeStageCodegen (25)"; 24012 [labelType="html" label="MapPartitionsRDD [24012] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56295 { label="WholeStageCodegen (26)"; 24013 [labelType="html" label="ZippedPartitionsRDD2 [24013] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24014 [labelType="html" label="MapPartitionsRDD [24014] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56312 { label="AQEShuffleRead"; 24015 [labelType="html" label="ShuffledRowRDD [24015] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56309 { label="WholeStageCodegen (27)"; 24016 [labelType="html" label="MapPartitionsRDD [24016] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56291 { label="WholeStageCodegen (28)"; 24017 [labelType="html" label="ZippedPartitionsRDD2 [24017] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24018 [labelType="html" label="MapPartitionsRDD [24018] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56317 { label="AQEShuffleRead"; 24019 [labelType="html" label="ShuffledRowRDD [24019] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56314 { label="WholeStageCodegen (29)"; 24020 [labelType="html" label="MapPartitionsRDD [24020] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56287 { label="WholeStageCodegen (30)"; 24021 [labelType="html" label="ZippedPartitionsRDD2 [24021] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24022 [labelType="html" label="MapPartitionsRDD [24022] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56286 { label="Exchange"; 24023 [labelType="html" label="MapPartitionsRDD [24023] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24009->24010; 24011->24012; 24010->24013; 24012->24013; 24013->24014; 24015->24016; 24014->24017; 24016->24017; 24017->24018; 24019->24020; 24018->24021; 24020->24021; 24021->24022; 24022->24023; }
24008,24009
23959,24011
23963,24015
23967,24019
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time