3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16909 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Process local: 12
Input Size / Records:
20.9 MiB / 1115956
Associated Job Ids:
8221
DAG Visualization
digraph G { subgraph clusterstage_16909 { label="Stage 16909"; subgraph cluster107968 { label="Scan parquet "; 46149 [labelType="html" label="FileScanRDD [46149]<br>parquet at PersistJob.java:35"]; 46150 [labelType="html" label="MapPartitionsRDD [46150]<br>parquet at PersistJob.java:35"]; } subgraph cluster107963 { label="WholeStageCodegen (1)"; 46151 [labelType="html" label="MapPartitionsRDD [46151]<br>parquet at PersistJob.java:35"]; } subgraph cluster107973 { label="Scan csv "; 46152 [labelType="html" label="FileScanRDD [46152]<br>parquet at PersistJob.java:35"]; 46153 [labelType="html" label="MapPartitionsRDD [46153]<br>parquet at PersistJob.java:35"]; } subgraph cluster107969 { label="WholeStageCodegen (2)"; 46154 [labelType="html" label="MapPartitionsRDD [46154]<br>parquet at PersistJob.java:35"]; } subgraph cluster107962 { label="CartesianProduct"; 46155 [labelType="html" label="UnsafeCartesianRDD [46155]<br>parquet at PersistJob.java:35"]; 46156 [labelType="html" label="MapPartitionsRDD [46156]<br>parquet at PersistJob.java:35"]; } subgraph cluster107959 { label="WholeStageCodegen (3)"; 46157 [labelType="html" label="MapPartitionsRDD [46157]<br>parquet at PersistJob.java:35"]; } subgraph cluster107958 { label="Exchange"; 46158 [labelType="html" label="MapPartitionsRDD [46158]<br>parquet at PersistJob.java:35"]; } } 46149->46150; 46150->46151; 46152->46153; 46153->46154; 46151->46155; 46154->46155; 46155->46156; 46156->46157; 46157->46158; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time