3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8067 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
54 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
252.0 B / 7
Associated Job Ids:
3814
DAG Visualization
digraph G { subgraph clusterstage_8067 { label="Stage 8067"; subgraph cluster49796 { label="Scan parquet "; 21462 [labelType="html" label="FileScanRDD [21462]<br>count at ColumnStatJob.java:47"]; 21463 [labelType="html" label="MapPartitionsRDD [21463]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49791 { label="WholeStageCodegen (1)"; 21464 [labelType="html" label="MapPartitionsRDD [21464]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49801 { label="Scan csv "; 21465 [labelType="html" label="FileScanRDD [21465]<br>count at ColumnStatJob.java:47"]; 21466 [labelType="html" label="MapPartitionsRDD [21466]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49797 { label="WholeStageCodegen (2)"; 21467 [labelType="html" label="MapPartitionsRDD [21467]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49790 { label="CartesianProduct"; 21468 [labelType="html" label="UnsafeCartesianRDD [21468]<br>count at ColumnStatJob.java:47"]; 21469 [labelType="html" label="MapPartitionsRDD [21469]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49787 { label="WholeStageCodegen (3)"; 21470 [labelType="html" label="MapPartitionsRDD [21470]<br>count at ColumnStatJob.java:47"]; } subgraph cluster49786 { label="Exchange"; 21471 [labelType="html" label="MapPartitionsRDD [21471]<br>count at ColumnStatJob.java:47"]; } } 21462->21463; 21463->21464; 21465->21466; 21466->21467; 21464->21468; 21467->21468; 21468->21469; 21469->21470; 21470->21471; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time