3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15209 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.5 KiB / 499
Associated Job Ids:
8011
DAG Visualization
digraph G { subgraph clusterstage_15209 { label="Stage 15209"; subgraph cluster98195 { label="Scan parquet "; 41485 [labelType="html" label="FileScanRDD [41485]<br>rdd at PersistJob.java:28"]; 41486 [labelType="html" label="MapPartitionsRDD [41486]<br>rdd at PersistJob.java:28"]; } subgraph cluster98190 { label="WholeStageCodegen (13)"; 41487 [labelType="html" label="MapPartitionsRDD [41487]<br>rdd at PersistJob.java:28"]; } subgraph cluster98201 { label="Scan parquet "; 41488 [labelType="html" label="FileScanRDD [41488]<br>rdd at PersistJob.java:28"]; 41489 [labelType="html" label="MapPartitionsRDD [41489]<br>rdd at PersistJob.java:28"]; } subgraph cluster98196 { label="WholeStageCodegen (14)"; 41490 [labelType="html" label="MapPartitionsRDD [41490]<br>rdd at PersistJob.java:28"]; } subgraph cluster98207 { label="Scan parquet "; 41491 [labelType="html" label="FileScanRDD [41491]<br>rdd at PersistJob.java:28"]; 41492 [labelType="html" label="MapPartitionsRDD [41492]<br>rdd at PersistJob.java:28"]; } subgraph cluster98202 { label="WholeStageCodegen (15)"; 41493 [labelType="html" label="MapPartitionsRDD [41493]<br>rdd at PersistJob.java:28"]; } subgraph cluster98189 { label="Union"; 41494 [labelType="html" label="UnionRDD [41494]<br>rdd at PersistJob.java:28"]; } subgraph cluster98188 { label="Exchange"; 41495 [labelType="html" label="MapPartitionsRDD [41495]<br>rdd at PersistJob.java:28"]; } } 41485->41486; 41486->41487; 41488->41489; 41489->41490; 41491->41492; 41492->41493; 41487->41494; 41490->41494; 41493->41494; 41494->41495; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time