3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16905 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 10
Input Size / Records:
4.2 MiB / 258304
Output Size / Records:
39.4 KiB / 40
Associated Job Ids:
8218
DAG Visualization
digraph G { subgraph clusterstage_16905 { label="Stage 16905"; subgraph cluster107928 { label="Scan parquet "; 46128 [labelType="html" label="FileScanRDD [46128]<br>parquet at PersistJob.java:35"]; 46129 [labelType="html" label="MapPartitionsRDD [46129]<br>parquet at PersistJob.java:35"]; } subgraph cluster107923 { label="WholeStageCodegen (1)"; 46130 [labelType="html" label="MapPartitionsRDD [46130]<br>parquet at PersistJob.java:35"]; } subgraph cluster107951 { label="Scan csv "; 46131 [labelType="html" label="FileScanRDD [46131]<br>parquet at PersistJob.java:35"]; 46132 [labelType="html" label="MapPartitionsRDD [46132]<br>parquet at PersistJob.java:35"]; } subgraph cluster107947 { label="WholeStageCodegen (2)"; 46135 [labelType="html" label="MapPartitionsRDD [46135]<br>parquet at PersistJob.java:35"]; } subgraph cluster107922 { label="CartesianProduct"; 46136 [labelType="html" label="UnsafeCartesianRDD [46136]<br>parquet at PersistJob.java:35"]; 46137 [labelType="html" label="MapPartitionsRDD [46137]<br>parquet at PersistJob.java:35"]; } subgraph cluster107918 { label="WholeStageCodegen (3)"; 46140 [labelType="html" label="MapPartitionsRDD [46140]<br>parquet at PersistJob.java:35"]; } subgraph cluster107917 { label="WriteFiles"; 46141 [labelType="html" label="MapPartitionsRDD [46141]<br>parquet at PersistJob.java:35"]; } } 46128->46129; 46129->46130; 46131->46132; 46132->46135; 46130->46136; 46135->46136; 46136->46137; 46137->46140; 46140->46141; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time