3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32660 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
75 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.2 KiB / 489
Shuffle Write Size / Records:
7.1 KiB / 489
Associated Job Ids:
17998
DAG Visualization
digraph G { subgraph clusterstage_32660 { label="Stage 32660"; subgraph cluster208557 { label="Scan parquet "; 90266 [labelType="html" label="FileScanRDD [90266]<br>parquet at PersistJob.java:35"]; 90267 [labelType="html" label="MapPartitionsRDD [90267]<br>parquet at PersistJob.java:35"]; } subgraph cluster208552 { label="WholeStageCodegen (13)"; 90268 [labelType="html" label="MapPartitionsRDD [90268]<br>parquet at PersistJob.java:35"]; } subgraph cluster208563 { label="Scan parquet "; 90269 [labelType="html" label="FileScanRDD [90269]<br>parquet at PersistJob.java:35"]; 90270 [labelType="html" label="MapPartitionsRDD [90270]<br>parquet at PersistJob.java:35"]; } subgraph cluster208558 { label="WholeStageCodegen (14)"; 90271 [labelType="html" label="MapPartitionsRDD [90271]<br>parquet at PersistJob.java:35"]; } subgraph cluster208569 { label="Scan parquet "; 90272 [labelType="html" label="FileScanRDD [90272]<br>parquet at PersistJob.java:35"]; 90273 [labelType="html" label="MapPartitionsRDD [90273]<br>parquet at PersistJob.java:35"]; } subgraph cluster208564 { label="WholeStageCodegen (15)"; 90274 [labelType="html" label="MapPartitionsRDD [90274]<br>parquet at PersistJob.java:35"]; } subgraph cluster208551 { label="Union"; 90275 [labelType="html" label="UnionRDD [90275]<br>parquet at PersistJob.java:35"]; } subgraph cluster208550 { label="Exchange"; 90276 [labelType="html" label="MapPartitionsRDD [90276]<br>parquet at PersistJob.java:35"]; } } 90266->90267; 90267->90268; 90269->90270; 90270->90271; 90272->90273; 90273->90274; 90268->90275; 90271->90275; 90274->90275; 90275->90276; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time