3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15985 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1427.5 KiB / 85900
Shuffle Write Size / Records:
790.5 KiB / 37268
Associated Job Ids:
7792
DAG Visualization
digraph G { subgraph clusterstage_15985 { label="Stage 15985"; subgraph cluster101823 { label="Scan parquet "; 43468 [labelType="html" label="FileScanRDD [43468]<br>parquet at PersistJob.java:35"]; 43469 [labelType="html" label="MapPartitionsRDD [43469]<br>parquet at PersistJob.java:35"]; } subgraph cluster101818 { label="WholeStageCodegen (1)"; 43470 [labelType="html" label="MapPartitionsRDD [43470]<br>parquet at PersistJob.java:35"]; } subgraph cluster101828 { label="Scan csv "; 43471 [labelType="html" label="FileScanRDD [43471]<br>parquet at PersistJob.java:35"]; 43472 [labelType="html" label="MapPartitionsRDD [43472]<br>parquet at PersistJob.java:35"]; } subgraph cluster101824 { label="WholeStageCodegen (2)"; 43473 [labelType="html" label="MapPartitionsRDD [43473]<br>parquet at PersistJob.java:35"]; } subgraph cluster101817 { label="CartesianProduct"; 43474 [labelType="html" label="UnsafeCartesianRDD [43474]<br>parquet at PersistJob.java:35"]; 43475 [labelType="html" label="MapPartitionsRDD [43475]<br>parquet at PersistJob.java:35"]; } subgraph cluster101814 { label="WholeStageCodegen (3)"; 43476 [labelType="html" label="MapPartitionsRDD [43476]<br>parquet at PersistJob.java:35"]; } subgraph cluster101813 { label="ObjectHashAggregate"; 43477 [labelType="html" label="MapPartitionsRDD [43477]<br>parquet at PersistJob.java:35"]; } subgraph cluster101812 { label="Exchange"; 43478 [labelType="html" label="MapPartitionsRDD [43478]<br>parquet at PersistJob.java:35"]; } } 43468->43469; 43469->43470; 43471->43472; 43472->43473; 43470->43474; 43473->43474; 43474->43475; 43475->43476; 43476->43477; 43477->43478; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time