3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32553 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
5.8 MiB / 591893
Shuffle Write Size / Records:
6.4 MiB / 591883
Associated Job Ids:
17933
DAG Visualization
digraph G { subgraph clusterstage_32553 { label="Stage 32553"; subgraph cluster207382 { label="Scan parquet "; 89762 [labelType="html" label="FileScanRDD [89762]<br>rdd at PersistJob.java:28"]; 89763 [labelType="html" label="MapPartitionsRDD [89763]<br>rdd at PersistJob.java:28"]; } subgraph cluster207377 { label="WholeStageCodegen (1)"; 89764 [labelType="html" label="MapPartitionsRDD [89764]<br>rdd at PersistJob.java:28"]; } subgraph cluster207387 { label="Scan csv "; 89765 [labelType="html" label="FileScanRDD [89765]<br>rdd at PersistJob.java:28"]; 89766 [labelType="html" label="MapPartitionsRDD [89766]<br>rdd at PersistJob.java:28"]; } subgraph cluster207383 { label="WholeStageCodegen (2)"; 89767 [labelType="html" label="MapPartitionsRDD [89767]<br>rdd at PersistJob.java:28"]; } subgraph cluster207376 { label="CartesianProduct"; 89768 [labelType="html" label="UnsafeCartesianRDD [89768]<br>rdd at PersistJob.java:28"]; 89769 [labelType="html" label="MapPartitionsRDD [89769]<br>rdd at PersistJob.java:28"]; } subgraph cluster207373 { label="WholeStageCodegen (3)"; 89770 [labelType="html" label="MapPartitionsRDD [89770]<br>rdd at PersistJob.java:28"]; } subgraph cluster207372 { label="Exchange"; 89771 [labelType="html" label="MapPartitionsRDD [89771]<br>rdd at PersistJob.java:28"]; } } 89762->89763; 89763->89764; 89765->89766; 89766->89767; 89764->89768; 89767->89768; 89768->89769; 89769->89770; 89770->89771; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time