3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16866 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
23 s
Locality Level Summary:
Process local: 12
Input Size / Records:
10.6 MiB / 1115968
Shuffle Write Size / Records:
8.7 MiB / 427306
Associated Job Ids:
8187
DAG Visualization
digraph G { subgraph clusterstage_16866 { label="Stage 16866"; subgraph cluster107454 { label="Scan parquet "; 45862 [labelType="html" label="FileScanRDD [45862]<br>rdd at PersistJob.java:28"]; 45863 [labelType="html" label="MapPartitionsRDD [45863]<br>rdd at PersistJob.java:28"]; } subgraph cluster107445 { label="WholeStageCodegen (1)"; 45865 [labelType="html" label="MapPartitionsRDD [45865]<br>rdd at PersistJob.java:28"]; } subgraph cluster107461 { label="Scan csv "; 45869 [labelType="html" label="FileScanRDD [45869]<br>rdd at PersistJob.java:28"]; 45870 [labelType="html" label="MapPartitionsRDD [45870]<br>rdd at PersistJob.java:28"]; } subgraph cluster107457 { label="WholeStageCodegen (2)"; 45871 [labelType="html" label="MapPartitionsRDD [45871]<br>rdd at PersistJob.java:28"]; } subgraph cluster107444 { label="CartesianProduct"; 45872 [labelType="html" label="UnsafeCartesianRDD [45872]<br>rdd at PersistJob.java:28"]; 45873 [labelType="html" label="MapPartitionsRDD [45873]<br>rdd at PersistJob.java:28"]; } subgraph cluster107436 { label="WholeStageCodegen (3)"; 45874 [labelType="html" label="MapPartitionsRDD [45874]<br>rdd at PersistJob.java:28"]; } subgraph cluster107435 { label="ObjectHashAggregate"; 45875 [labelType="html" label="MapPartitionsRDD [45875]<br>rdd at PersistJob.java:28"]; } subgraph cluster107434 { label="Exchange"; 45876 [labelType="html" label="MapPartitionsRDD [45876]<br>rdd at PersistJob.java:28"]; } } 45862->45863; 45863->45865; 45869->45870; 45870->45871; 45865->45872; 45871->45872; 45872->45873; 45873->45874; 45874->45875; 45875->45876; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time