3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16885 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 12
Input Size / Records:
10.6 MiB / 1115968
Shuffle Write Size / Records:
8.7 MiB / 427306
Associated Job Ids:
8204
DAG Visualization
digraph G { subgraph clusterstage_16885 { label="Stage 16885"; subgraph cluster107698 { label="Scan parquet "; 46007 [labelType="html" label="FileScanRDD [46007]<br>parquet at PersistJob.java:35"]; 46008 [labelType="html" label="MapPartitionsRDD [46008]<br>parquet at PersistJob.java:35"]; } subgraph cluster107693 { label="WholeStageCodegen (1)"; 46009 [labelType="html" label="MapPartitionsRDD [46009]<br>parquet at PersistJob.java:35"]; } subgraph cluster107703 { label="Scan csv "; 46010 [labelType="html" label="FileScanRDD [46010]<br>parquet at PersistJob.java:35"]; 46011 [labelType="html" label="MapPartitionsRDD [46011]<br>parquet at PersistJob.java:35"]; } subgraph cluster107699 { label="WholeStageCodegen (2)"; 46012 [labelType="html" label="MapPartitionsRDD [46012]<br>parquet at PersistJob.java:35"]; } subgraph cluster107692 { label="CartesianProduct"; 46013 [labelType="html" label="UnsafeCartesianRDD [46013]<br>parquet at PersistJob.java:35"]; 46014 [labelType="html" label="MapPartitionsRDD [46014]<br>parquet at PersistJob.java:35"]; } subgraph cluster107689 { label="WholeStageCodegen (3)"; 46015 [labelType="html" label="MapPartitionsRDD [46015]<br>parquet at PersistJob.java:35"]; } subgraph cluster107688 { label="ObjectHashAggregate"; 46016 [labelType="html" label="MapPartitionsRDD [46016]<br>parquet at PersistJob.java:35"]; } subgraph cluster107687 { label="Exchange"; 46017 [labelType="html" label="MapPartitionsRDD [46017]<br>parquet at PersistJob.java:35"]; } } 46007->46008; 46008->46009; 46010->46011; 46011->46012; 46009->46013; 46012->46013; 46013->46014; 46014->46015; 46015->46016; 46016->46017; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time