3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5719 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1116.7 KiB / 493876
Shuffle Write Size / Records:
2.0 MiB / 493871
Associated Job Ids:
3078
DAG Visualization
digraph G { subgraph clusterstage_5719 { label="Stage 5719"; subgraph cluster36248 { label="Scan parquet "; 15013 [labelType="html" label="FileScanRDD [15013]<br>count at ColumnStatJob.java:47"]; 15014 [labelType="html" label="MapPartitionsRDD [15014]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36244 { label="WholeStageCodegen (1)"; 15015 [labelType="html" label="MapPartitionsRDD [15015]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36253 { label="Scan csv "; 15016 [labelType="html" label="FileScanRDD [15016]<br>count at ColumnStatJob.java:47"]; 15017 [labelType="html" label="MapPartitionsRDD [15017]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36249 { label="WholeStageCodegen (2)"; 15018 [labelType="html" label="MapPartitionsRDD [15018]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36243 { label="CartesianProduct"; 15019 [labelType="html" label="UnsafeCartesianRDD [15019]<br>count at ColumnStatJob.java:47"]; 15020 [labelType="html" label="MapPartitionsRDD [15020]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36240 { label="WholeStageCodegen (3)"; 15021 [labelType="html" label="MapPartitionsRDD [15021]<br>count at ColumnStatJob.java:47"]; } subgraph cluster36239 { label="Exchange"; 15022 [labelType="html" label="MapPartitionsRDD [15022]<br>count at ColumnStatJob.java:47"]; } } 15013->15014; 15014->15015; 15016->15017; 15017->15018; 15015->15019; 15018->15019; 15019->15020; 15020->15021; 15021->15022; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time