3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44945 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
92 ms
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
918.0 B / 8
Associated Job Ids:
23849
DAG Visualization
digraph G { subgraph clusterstage_44945 { label="Stage 44945"; subgraph cluster310128 { label="AQEShuffleRead"; 135814 [labelType="html" label="ShuffledRowRDD [135814] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310125 { label="WholeStageCodegen (4)"; 135815 [labelType="html" label="MapPartitionsRDD [135815] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310124 { label="Window"; 135816 [labelType="html" label="MapPartitionsRDD [135816] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310118 { label="WholeStageCodegen (5)"; 135817 [labelType="html" label="MapPartitionsRDD [135817] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310132 { label="AQEShuffleRead"; 135818 [labelType="html" label="ShuffledRowRDD [135818] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310129 { label="WholeStageCodegen (6)"; 135819 [labelType="html" label="MapPartitionsRDD [135819] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310117 { label="Union"; 135820 [labelType="html" label="UnionRDD [135820] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310114 { label="WholeStageCodegen (7)"; 135821 [labelType="html" label="MapPartitionsRDD [135821] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster310113 { label="TakeOrderedAndProject"; 135822 [labelType="html" label="MapPartitionsRDD [135822] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 135823 [labelType="html" label="MapPartitionsRDD [135823] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 135814->135815; 135815->135816; 135816->135817; 135818->135819; 135817->135820; 135819->135820; 135820->135821; 135821->135822; 135822->135823; }
135803,135814
135813,135818
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time