3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15998 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1861.5 KiB / 85905
Shuffle Write Size / Records:
1853.9 KiB / 85895
Associated Job Ids:
7801
DAG Visualization
digraph G { subgraph clusterstage_15998 { label="Stage 15998"; subgraph cluster101997 { label="Scan parquet "; 43564 [labelType="html" label="FileScanRDD [43564]<br>parquet at PersistJob.java:35"]; 43565 [labelType="html" label="MapPartitionsRDD [43565]<br>parquet at PersistJob.java:35"]; } subgraph cluster101992 { label="WholeStageCodegen (1)"; 43566 [labelType="html" label="MapPartitionsRDD [43566]<br>parquet at PersistJob.java:35"]; } subgraph cluster102002 { label="Scan csv "; 43567 [labelType="html" label="FileScanRDD [43567]<br>parquet at PersistJob.java:35"]; 43568 [labelType="html" label="MapPartitionsRDD [43568]<br>parquet at PersistJob.java:35"]; } subgraph cluster101998 { label="WholeStageCodegen (2)"; 43569 [labelType="html" label="MapPartitionsRDD [43569]<br>parquet at PersistJob.java:35"]; } subgraph cluster101991 { label="CartesianProduct"; 43570 [labelType="html" label="UnsafeCartesianRDD [43570]<br>parquet at PersistJob.java:35"]; 43571 [labelType="html" label="MapPartitionsRDD [43571]<br>parquet at PersistJob.java:35"]; } subgraph cluster102007 { label="Scan csv "; 43572 [labelType="html" label="FileScanRDD [43572]<br>parquet at PersistJob.java:35"]; 43573 [labelType="html" label="MapPartitionsRDD [43573]<br>parquet at PersistJob.java:35"]; } subgraph cluster102003 { label="WholeStageCodegen (3)"; 43574 [labelType="html" label="MapPartitionsRDD [43574]<br>parquet at PersistJob.java:35"]; } subgraph cluster101990 { label="CartesianProduct"; 43575 [labelType="html" label="UnsafeCartesianRDD [43575]<br>parquet at PersistJob.java:35"]; 43576 [labelType="html" label="MapPartitionsRDD [43576]<br>parquet at PersistJob.java:35"]; } subgraph cluster101987 { label="WholeStageCodegen (4)"; 43577 [labelType="html" label="MapPartitionsRDD [43577]<br>parquet at PersistJob.java:35"]; } subgraph cluster101986 { label="Exchange"; 43578 [labelType="html" label="MapPartitionsRDD [43578]<br>parquet at PersistJob.java:35"]; } } 43564->43565; 43565->43566; 43567->43568; 43568->43569; 43566->43570; 43569->43570; 43570->43571; 43572->43573; 43573->43574; 43571->43575; 43574->43575; 43575->43576; 43576->43577; 43577->43578; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time