3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18482 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
13.6 MiB / 259668
Shuffle Write Size / Records:
18.8 MiB / 259658
Associated Job Ids:
9249
DAG Visualization
digraph G { subgraph clusterstage_18482 { label="Stage 18482"; subgraph cluster120684 { label="Scan parquet "; 51763 [labelType="html" label="FileScanRDD [51763]<br>count at ColumnStatJob.java:47"]; 51764 [labelType="html" label="MapPartitionsRDD [51764]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120680 { label="WholeStageCodegen (1)"; 51765 [labelType="html" label="MapPartitionsRDD [51765]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120689 { label="Scan csv "; 51766 [labelType="html" label="FileScanRDD [51766]<br>count at ColumnStatJob.java:47"]; 51767 [labelType="html" label="MapPartitionsRDD [51767]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120685 { label="WholeStageCodegen (2)"; 51768 [labelType="html" label="MapPartitionsRDD [51768]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120679 { label="CartesianProduct"; 51769 [labelType="html" label="UnsafeCartesianRDD [51769]<br>count at ColumnStatJob.java:47"]; 51770 [labelType="html" label="MapPartitionsRDD [51770]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120675 { label="WholeStageCodegen (3)"; 51771 [labelType="html" label="MapPartitionsRDD [51771]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120674 { label="Exchange"; 51772 [labelType="html" label="MapPartitionsRDD [51772]<br>count at ColumnStatJob.java:47"]; } } 51763->51764; 51764->51765; 51766->51767; 51767->51768; 51765->51769; 51768->51769; 51769->51770; 51770->51771; 51771->51772; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time