3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16881 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.8 MiB / 48276
Output Size / Records:
1454.0 B / 0
Associated Job Ids:
8200
DAG Visualization
digraph G { subgraph clusterstage_16881 { label="Stage 16881"; subgraph cluster107646 { label="Scan parquet "; 45975 [labelType="html" label="FileScanRDD [45975]<br>parquet at PersistJob.java:35"]; 45976 [labelType="html" label="MapPartitionsRDD [45976]<br>parquet at PersistJob.java:35"]; } subgraph cluster107639 { label="WholeStageCodegen (1)"; 45977 [labelType="html" label="MapPartitionsRDD [45977]<br>parquet at PersistJob.java:35"]; } subgraph cluster107651 { label="Scan csv "; 45978 [labelType="html" label="FileScanRDD [45978]<br>parquet at PersistJob.java:35"]; 45979 [labelType="html" label="MapPartitionsRDD [45979]<br>parquet at PersistJob.java:35"]; } subgraph cluster107647 { label="WholeStageCodegen (2)"; 45980 [labelType="html" label="MapPartitionsRDD [45980]<br>parquet at PersistJob.java:35"]; } subgraph cluster107638 { label="CartesianProduct"; 45981 [labelType="html" label="UnsafeCartesianRDD [45981]<br>parquet at PersistJob.java:35"]; 45982 [labelType="html" label="MapPartitionsRDD [45982]<br>parquet at PersistJob.java:35"]; } subgraph cluster107632 { label="WholeStageCodegen (3)"; 45983 [labelType="html" label="MapPartitionsRDD [45983]<br>parquet at PersistJob.java:35"]; } subgraph cluster107631 { label="WriteFiles"; 45984 [labelType="html" label="MapPartitionsRDD [45984]<br>parquet at PersistJob.java:35"]; } } 45975->45976; 45976->45977; 45978->45979; 45979->45980; 45977->45981; 45980->45981; 45981->45982; 45982->45983; 45983->45984; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time