3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12859 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
6323
DAG Visualization
digraph G { subgraph clusterstage_12859 { label="Stage 12859"; subgraph cluster83343 { label="Scan parquet "; 35429 [labelType="html" label="FileScanRDD [35429]<br>rdd at PersistJob.java:28"]; 35430 [labelType="html" label="MapPartitionsRDD [35430]<br>rdd at PersistJob.java:28"]; } subgraph cluster83338 { label="WholeStageCodegen (13)"; 35431 [labelType="html" label="MapPartitionsRDD [35431]<br>rdd at PersistJob.java:28"]; } subgraph cluster83349 { label="Scan parquet "; 35432 [labelType="html" label="FileScanRDD [35432]<br>rdd at PersistJob.java:28"]; 35433 [labelType="html" label="MapPartitionsRDD [35433]<br>rdd at PersistJob.java:28"]; } subgraph cluster83344 { label="WholeStageCodegen (14)"; 35434 [labelType="html" label="MapPartitionsRDD [35434]<br>rdd at PersistJob.java:28"]; } subgraph cluster83355 { label="Scan parquet "; 35435 [labelType="html" label="FileScanRDD [35435]<br>rdd at PersistJob.java:28"]; 35436 [labelType="html" label="MapPartitionsRDD [35436]<br>rdd at PersistJob.java:28"]; } subgraph cluster83350 { label="WholeStageCodegen (15)"; 35437 [labelType="html" label="MapPartitionsRDD [35437]<br>rdd at PersistJob.java:28"]; } subgraph cluster83337 { label="Union"; 35438 [labelType="html" label="UnionRDD [35438]<br>rdd at PersistJob.java:28"]; } subgraph cluster83336 { label="Exchange"; 35439 [labelType="html" label="MapPartitionsRDD [35439]<br>rdd at PersistJob.java:28"]; } } 35429->35430; 35430->35431; 35432->35433; 35433->35434; 35435->35436; 35436->35437; 35431->35438; 35434->35438; 35437->35438; 35438->35439; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time