3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16869 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 12
Input Size / Records:
15.2 MiB / 1115968
Shuffle Write Size / Records:
23.1 MiB / 1115956
Associated Job Ids:
8190
DAG Visualization
digraph G { subgraph clusterstage_16869 { label="Stage 16869"; subgraph cluster107497 { label="Scan parquet "; 45900 [labelType="html" label="FileScanRDD [45900]<br>parquet at PersistJob.java:35"]; 45901 [labelType="html" label="MapPartitionsRDD [45901]<br>parquet at PersistJob.java:35"]; } subgraph cluster107492 { label="WholeStageCodegen (1)"; 45902 [labelType="html" label="MapPartitionsRDD [45902]<br>parquet at PersistJob.java:35"]; } subgraph cluster107503 { label="Scan csv "; 45903 [labelType="html" label="FileScanRDD [45903]<br>parquet at PersistJob.java:35"]; 45904 [labelType="html" label="MapPartitionsRDD [45904]<br>parquet at PersistJob.java:35"]; } subgraph cluster107499 { label="WholeStageCodegen (2)"; 45905 [labelType="html" label="MapPartitionsRDD [45905]<br>parquet at PersistJob.java:35"]; } subgraph cluster107491 { label="CartesianProduct"; 45906 [labelType="html" label="UnsafeCartesianRDD [45906]<br>parquet at PersistJob.java:35"]; 45907 [labelType="html" label="MapPartitionsRDD [45907]<br>parquet at PersistJob.java:35"]; } subgraph cluster107488 { label="WholeStageCodegen (3)"; 45908 [labelType="html" label="MapPartitionsRDD [45908]<br>parquet at PersistJob.java:35"]; } subgraph cluster107487 { label="Exchange"; 45909 [labelType="html" label="MapPartitionsRDD [45909]<br>parquet at PersistJob.java:35"]; } } 45900->45901; 45901->45902; 45903->45904; 45904->45905; 45902->45906; 45905->45906; 45906->45907; 45907->45908; 45908->45909; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time