3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7810 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
3.5 MiB / 48492
Shuffle Write Size / Records:
3.6 MiB / 48482
Associated Job Ids:
3811
DAG Visualization
digraph G { subgraph clusterstage_7810 { label="Stage 7810"; subgraph cluster50779 { label="Scan parquet "; 22454 [labelType="html" label="FileScanRDD [22454]<br>parquet at PersistJob.java:35"]; 22455 [labelType="html" label="MapPartitionsRDD [22455]<br>parquet at PersistJob.java:35"]; } subgraph cluster50774 { label="WholeStageCodegen (1)"; 22456 [labelType="html" label="MapPartitionsRDD [22456]<br>parquet at PersistJob.java:35"]; } subgraph cluster50784 { label="Scan csv "; 22457 [labelType="html" label="FileScanRDD [22457]<br>parquet at PersistJob.java:35"]; 22458 [labelType="html" label="MapPartitionsRDD [22458]<br>parquet at PersistJob.java:35"]; } subgraph cluster50780 { label="WholeStageCodegen (2)"; 22459 [labelType="html" label="MapPartitionsRDD [22459]<br>parquet at PersistJob.java:35"]; } subgraph cluster50773 { label="CartesianProduct"; 22460 [labelType="html" label="UnsafeCartesianRDD [22460]<br>parquet at PersistJob.java:35"]; 22461 [labelType="html" label="MapPartitionsRDD [22461]<br>parquet at PersistJob.java:35"]; } subgraph cluster50765 { label="WholeStageCodegen (3)"; 22462 [labelType="html" label="MapPartitionsRDD [22462]<br>parquet at PersistJob.java:35"]; } subgraph cluster50764 { label="Exchange"; 22463 [labelType="html" label="MapPartitionsRDD [22463]<br>parquet at PersistJob.java:35"]; } } 22454->22455; 22455->22456; 22457->22458; 22458->22459; 22456->22460; 22459->22460; 22460->22461; 22461->22462; 22462->22463; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time