3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8059 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
84 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
3807
DAG Visualization
digraph G { subgraph clusterstage_8059 { label="Stage 8059"; subgraph cluster49700 { label="Scan parquet "; 21416 [labelType="html" label="FileScanRDD [21416]<br>count at ColumnStatJob.java:47"]; 21417 [labelType="html" label="MapPartitionsRDD [21417]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49695 { label="WholeStageCodegen (1)"; 21418 [labelType="html" label="MapPartitionsRDD [21418]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49705 { label="Scan csv "; 21420 [labelType="html" label="FileScanRDD [21420]<br>count at ColumnStatJob.java:47"]; 21421 [labelType="html" label="MapPartitionsRDD [21421]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49701 { label="WholeStageCodegen (2)"; 21422 [labelType="html" label="MapPartitionsRDD [21422]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49694 { label="CartesianProduct"; 21423 [labelType="html" label="UnsafeCartesianRDD [21423]<br>count at ColumnStatJob.java:47"]; 21425 [labelType="html" label="MapPartitionsRDD [21425]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49691 { label="WholeStageCodegen (3)"; 21426 [labelType="html" label="MapPartitionsRDD [21426]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49690 { label="Exchange"; 21427 [labelType="html" label="MapPartitionsRDD [21427]<br>count at ColumnStatJob.java:47"]; } } 21416->21417; 21417->21418; 21420->21421; 21421->21422; 21418->21423; 21422->21423; 21423->21425; 21425->21426; 21426->21427; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time