3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17275 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
28 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
97.9 MiB / 2124462
Shuffle Read Size / Records:
11.4 MiB / 261221
Associated Job Ids:
8405
DAG Visualization
digraph G { subgraph clusterstage_17275 { label="Stage 17275"; subgraph cluster110692 { label="Exchange"; 47287 [labelType="html" label="ShuffledRowRDD [47287] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110688 { label="WholeStageCodegen (18)"; 47288 [labelType="html" label="MapPartitionsRDD [47288] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110687 { label="Window"; 47289 [labelType="html" label="MapPartitionsRDD [47289] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110685 { label="Filter"; 47290 [labelType="html" label="MapPartitionsRDD [47290] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110684 { label="Project"; 47291 [labelType="html" label="MapPartitionsRDD [47291] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110683 { label="Project"; 47292 [labelType="html" label="MapPartitionsRDD [47292] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110682 { label="Project"; 47293 [labelType="html" label="MapPartitionsRDD [47293] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110681 { label="Project"; 47294 [labelType="html" label="MapPartitionsRDD [47294] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110680 { label="Project"; 47295 [labelType="html" label="MapPartitionsRDD [47295] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110698 { label="Scan parquet "; 47296 [labelType="html" label="FileScanRDD [47296]<br>takeAsList at DataFrameCommonJob.java:145"]; 47297 [labelType="html" label="MapPartitionsRDD [47297]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110693 { label="WholeStageCodegen (20)"; 47298 [labelType="html" label="MapPartitionsRDD [47298]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110663 { label="Union"; 47299 [labelType="html" label="UnionRDD [47299] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110662 { label="TakeOrderedAndProject"; 47300 [labelType="html" label="MapPartitionsRDD [47300] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 47301 [labelType="html" label="MapPartitionsRDD [47301] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 47287->47288; 47288->47289; 47289->47290; 47290->47291; 47291->47292; 47292->47293; 47293->47294; 47294->47295; 47296->47297; 47297->47298; 47295->47299; 47298->47299; 47299->47300; 47300->47301; }
47276,47287
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time