3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16112 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Write Size / Records:
193.0 B / 1
Associated Job Ids:
8121
DAG Visualization
digraph G { subgraph clusterstage_16112 { label="Stage 16112"; subgraph cluster105341 { label="Scan parquet "; 45229 [labelType="html" label="FileScanRDD [45229]<br>parquet at PersistJob.java:35"]; 45230 [labelType="html" label="MapPartitionsRDD [45230]<br>parquet at PersistJob.java:35"]; } subgraph cluster105336 { label="WholeStageCodegen (2)"; 45231 [labelType="html" label="MapPartitionsRDD [45231]<br>parquet at PersistJob.java:35"]; } subgraph cluster105346 { label="Scan csv "; 45232 [labelType="html" label="FileScanRDD [45232]<br>parquet at PersistJob.java:35"]; 45233 [labelType="html" label="MapPartitionsRDD [45233]<br>parquet at PersistJob.java:35"]; } subgraph cluster105342 { label="WholeStageCodegen (3)"; 45234 [labelType="html" label="MapPartitionsRDD [45234]<br>parquet at PersistJob.java:35"]; } subgraph cluster105335 { label="CartesianProduct"; 45235 [labelType="html" label="UnsafeCartesianRDD [45235]<br>parquet at PersistJob.java:35"]; 45236 [labelType="html" label="MapPartitionsRDD [45236]<br>parquet at PersistJob.java:35"]; } subgraph cluster105331 { label="WholeStageCodegen (4)"; 45237 [labelType="html" label="MapPartitionsRDD [45237]<br>parquet at PersistJob.java:35"]; } subgraph cluster105330 { label="ObjectHashAggregate"; 45238 [labelType="html" label="MapPartitionsRDD [45238]<br>parquet at PersistJob.java:35"]; } subgraph cluster105329 { label="Exchange"; 45239 [labelType="html" label="MapPartitionsRDD [45239]<br>parquet at PersistJob.java:35"]; } } 45229->45230; 45230->45231; 45232->45233; 45233->45234; 45231->45235; 45234->45235; 45235->45236; 45236->45237; 45237->45238; 45238->45239; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time