3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15292 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
742.7 KiB / 6263
Shuffle Write Size / Records:
489.2 KiB / 6253
Associated Job Ids:
7729
DAG Visualization
digraph G { subgraph clusterstage_15292 { label="Stage 15292"; subgraph cluster99544 { label="Scan parquet "; 42306 [labelType="html" label="FileScanRDD [42306]<br>count at ColumnStatJob.java:47"]; 42307 [labelType="html" label="MapPartitionsRDD [42307]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99540 { label="WholeStageCodegen (1)"; 42308 [labelType="html" label="MapPartitionsRDD [42308]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99549 { label="Scan csv "; 42309 [labelType="html" label="FileScanRDD [42309]<br>count at ColumnStatJob.java:47"]; 42310 [labelType="html" label="MapPartitionsRDD [42310]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99545 { label="WholeStageCodegen (2)"; 42311 [labelType="html" label="MapPartitionsRDD [42311]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99539 { label="CartesianProduct"; 42312 [labelType="html" label="UnsafeCartesianRDD [42312]<br>count at ColumnStatJob.java:47"]; 42313 [labelType="html" label="MapPartitionsRDD [42313]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99531 { label="WholeStageCodegen (3)"; 42314 [labelType="html" label="MapPartitionsRDD [42314]<br>count at ColumnStatJob.java:47"]; } subgraph cluster99530 { label="Exchange"; 42315 [labelType="html" label="MapPartitionsRDD [42315]<br>count at ColumnStatJob.java:47"]; } } 42306->42307; 42307->42308; 42309->42310; 42310->42311; 42308->42312; 42311->42312; 42312->42313; 42313->42314; 42314->42315; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time