3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13567 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.5 MiB / 2231133
Shuffle Read Size / Records:
3.4 KiB / 10
Shuffle Write Size / Records:
4.9 KiB / 99
Associated Job Ids:
6803
DAG Visualization
digraph G { subgraph clusterstage_13567 { label="Stage 13567"; subgraph cluster88353 { label="Scan parquet "; 37588 [labelType="html" label="FileScanRDD [37588]<br>rdd at PersistJob.java:28"]; 37589 [labelType="html" label="MapPartitionsRDD [37589]<br>rdd at PersistJob.java:28"]; } subgraph cluster88348 { label="WholeStageCodegen (34)"; 37590 [labelType="html" label="MapPartitionsRDD [37590]<br>rdd at PersistJob.java:28"]; } subgraph cluster88356 { label="Exchange"; 37591 [labelType="html" label="ShuffledRowRDD [37591] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88354 { label="ObjectHashAggregate"; 37592 [labelType="html" label="MapPartitionsRDD [37592] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88347 { label="CartesianProduct"; 37593 [labelType="html" label="UnsafeCartesianRDD [37593] [Unordered]<br>rdd at PersistJob.java:28"]; 37594 [labelType="html" label="MapPartitionsRDD [37594] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88361 { label="Scan csv "; 37595 [labelType="html" label="FileScanRDD [37595]<br>rdd at PersistJob.java:28"]; 37596 [labelType="html" label="MapPartitionsRDD [37596]<br>rdd at PersistJob.java:28"]; } subgraph cluster88357 { label="WholeStageCodegen (35)"; 37597 [labelType="html" label="MapPartitionsRDD [37597]<br>rdd at PersistJob.java:28"]; } subgraph cluster88346 { label="CartesianProduct"; 37598 [labelType="html" label="UnsafeCartesianRDD [37598] [Unordered]<br>rdd at PersistJob.java:28"]; 37599 [labelType="html" label="MapPartitionsRDD [37599] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88342 { label="WholeStageCodegen (36)"; 37600 [labelType="html" label="MapPartitionsRDD [37600] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88341 { label="ObjectHashAggregate"; 37601 [labelType="html" label="MapPartitionsRDD [37601] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88340 { label="Exchange"; 37602 [labelType="html" label="MapPartitionsRDD [37602] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37588->37589; 37589->37590; 37591->37592; 37590->37593; 37592->37593; 37593->37594; 37595->37596; 37596->37597; 37594->37598; 37597->37598; 37598->37599; 37599->37600; 37600->37601; 37601->37602; }
37488,37591
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time