3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16896 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
20.9 MiB / 1115956
Associated Job Ids:
8211
DAG Visualization
digraph G { subgraph clusterstage_16896 { label="Stage 16896"; subgraph cluster107783 { label="Scan parquet "; 46054 [labelType="html" label="FileScanRDD [46054]<br>rdd at PersistJob.java:28"]; 46055 [labelType="html" label="MapPartitionsRDD [46055]<br>rdd at PersistJob.java:28"]; } subgraph cluster107778 { label="WholeStageCodegen (1)"; 46056 [labelType="html" label="MapPartitionsRDD [46056]<br>rdd at PersistJob.java:28"]; } subgraph cluster107791 { label="Scan csv "; 46057 [labelType="html" label="FileScanRDD [46057]<br>rdd at PersistJob.java:28"]; 46058 [labelType="html" label="MapPartitionsRDD [46058]<br>rdd at PersistJob.java:28"]; } subgraph cluster107787 { label="WholeStageCodegen (2)"; 46059 [labelType="html" label="MapPartitionsRDD [46059]<br>rdd at PersistJob.java:28"]; } subgraph cluster107777 { label="CartesianProduct"; 46060 [labelType="html" label="UnsafeCartesianRDD [46060]<br>rdd at PersistJob.java:28"]; 46061 [labelType="html" label="MapPartitionsRDD [46061]<br>rdd at PersistJob.java:28"]; } subgraph cluster107774 { label="WholeStageCodegen (3)"; 46062 [labelType="html" label="MapPartitionsRDD [46062]<br>rdd at PersistJob.java:28"]; } subgraph cluster107773 { label="Exchange"; 46063 [labelType="html" label="MapPartitionsRDD [46063]<br>rdd at PersistJob.java:28"]; } } 46054->46055; 46055->46056; 46057->46058; 46058->46059; 46056->46060; 46059->46060; 46060->46061; 46061->46062; 46062->46063; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time