3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15735 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.2 KiB / 532
Associated Job Ids:
7973
DAG Visualization
digraph G { subgraph clusterstage_15735 { label="Stage 15735"; subgraph cluster102893 { label="Scan parquet "; 43989 [labelType="html" label="FileScanRDD [43989]<br>rdd at PersistJob.java:28"]; 43990 [labelType="html" label="MapPartitionsRDD [43990]<br>rdd at PersistJob.java:28"]; } subgraph cluster102888 { label="WholeStageCodegen (17)"; 43991 [labelType="html" label="MapPartitionsRDD [43991]<br>rdd at PersistJob.java:28"]; } subgraph cluster102899 { label="Scan parquet "; 43992 [labelType="html" label="FileScanRDD [43992]<br>rdd at PersistJob.java:28"]; 43993 [labelType="html" label="MapPartitionsRDD [43993]<br>rdd at PersistJob.java:28"]; } subgraph cluster102894 { label="WholeStageCodegen (18)"; 43994 [labelType="html" label="MapPartitionsRDD [43994]<br>rdd at PersistJob.java:28"]; } subgraph cluster102905 { label="Scan parquet "; 43995 [labelType="html" label="FileScanRDD [43995]<br>rdd at PersistJob.java:28"]; 43996 [labelType="html" label="MapPartitionsRDD [43996]<br>rdd at PersistJob.java:28"]; } subgraph cluster102900 { label="WholeStageCodegen (19)"; 43997 [labelType="html" label="MapPartitionsRDD [43997]<br>rdd at PersistJob.java:28"]; } subgraph cluster102887 { label="Union"; 43998 [labelType="html" label="UnionRDD [43998]<br>rdd at PersistJob.java:28"]; } subgraph cluster102886 { label="Exchange"; 43999 [labelType="html" label="MapPartitionsRDD [43999]<br>rdd at PersistJob.java:28"]; } } 43989->43990; 43990->43991; 43992->43993; 43993->43994; 43995->43996; 43996->43997; 43991->43998; 43994->43998; 43997->43998; 43998->43999; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time