3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16120 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 5
Input Size / Records:
997.5 KiB / 74864
Associated Job Ids:
8129
DAG Visualization
digraph G { subgraph clusterstage_16120 { label="Stage 16120"; subgraph cluster105401 { label="Scan parquet "; 45275 [labelType="html" label="FileScanRDD [45275]<br>parquet at PersistJob.java:35"]; 45276 [labelType="html" label="MapPartitionsRDD [45276]<br>parquet at PersistJob.java:35"]; } subgraph cluster105396 { label="WholeStageCodegen (12)"; 45277 [labelType="html" label="MapPartitionsRDD [45277]<br>parquet at PersistJob.java:35"]; } subgraph cluster105406 { label="Scan csv "; 45278 [labelType="html" label="FileScanRDD [45278]<br>parquet at PersistJob.java:35"]; 45279 [labelType="html" label="MapPartitionsRDD [45279]<br>parquet at PersistJob.java:35"]; } subgraph cluster105402 { label="WholeStageCodegen (13)"; 45280 [labelType="html" label="MapPartitionsRDD [45280]<br>parquet at PersistJob.java:35"]; } subgraph cluster105395 { label="CartesianProduct"; 45281 [labelType="html" label="UnsafeCartesianRDD [45281]<br>parquet at PersistJob.java:35"]; 45282 [labelType="html" label="MapPartitionsRDD [45282]<br>parquet at PersistJob.java:35"]; } subgraph cluster105391 { label="WholeStageCodegen (14)"; 45283 [labelType="html" label="MapPartitionsRDD [45283]<br>parquet at PersistJob.java:35"]; } subgraph cluster105390 { label="ObjectHashAggregate"; 45284 [labelType="html" label="MapPartitionsRDD [45284]<br>parquet at PersistJob.java:35"]; } subgraph cluster105389 { label="Exchange"; 45285 [labelType="html" label="MapPartitionsRDD [45285]<br>parquet at PersistJob.java:35"]; } } 45275->45276; 45276->45277; 45278->45279; 45279->45280; 45277->45281; 45280->45281; 45281->45282; 45282->45283; 45283->45284; 45284->45285; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time