3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15104 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 5
Input Size / Records:
2033.0 KiB / 85895
Associated Job Ids:
7938
DAG Visualization
digraph G { subgraph clusterstage_15104 { label="Stage 15104"; subgraph cluster97137 { label="Scan parquet "; 40988 [labelType="html" label="FileScanRDD [40988]<br>parquet at PersistJob.java:35"]; 40989 [labelType="html" label="MapPartitionsRDD [40989]<br>parquet at PersistJob.java:35"]; } subgraph cluster97132 { label="WholeStageCodegen (1)"; 40990 [labelType="html" label="MapPartitionsRDD [40990]<br>parquet at PersistJob.java:35"]; } subgraph cluster97142 { label="Scan csv "; 40991 [labelType="html" label="FileScanRDD [40991]<br>parquet at PersistJob.java:35"]; 40992 [labelType="html" label="MapPartitionsRDD [40992]<br>parquet at PersistJob.java:35"]; } subgraph cluster97138 { label="WholeStageCodegen (2)"; 40993 [labelType="html" label="MapPartitionsRDD [40993]<br>parquet at PersistJob.java:35"]; } subgraph cluster97131 { label="CartesianProduct"; 40994 [labelType="html" label="UnsafeCartesianRDD [40994]<br>parquet at PersistJob.java:35"]; 40995 [labelType="html" label="MapPartitionsRDD [40995]<br>parquet at PersistJob.java:35"]; } subgraph cluster97128 { label="WholeStageCodegen (3)"; 40996 [labelType="html" label="MapPartitionsRDD [40996]<br>parquet at PersistJob.java:35"]; } subgraph cluster97127 { label="Exchange"; 40997 [labelType="html" label="MapPartitionsRDD [40997]<br>parquet at PersistJob.java:35"]; } } 40988->40989; 40989->40990; 40991->40992; 40992->40993; 40990->40994; 40993->40994; 40994->40995; 40995->40996; 40996->40997; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time