3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7936 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
27 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
98.2 MiB / 2132018
Shuffle Read Size / Records:
11.4 MiB / 262408
Associated Job Ids:
3882
DAG Visualization
digraph G { subgraph clusterstage_7936 { label="Stage 7936"; subgraph cluster51833 { label="Exchange"; 22903 [labelType="html" label="ShuffledRowRDD [22903] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51829 { label="WholeStageCodegen (18)"; 22904 [labelType="html" label="MapPartitionsRDD [22904] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51828 { label="Window"; 22905 [labelType="html" label="MapPartitionsRDD [22905] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51826 { label="Filter"; 22906 [labelType="html" label="MapPartitionsRDD [22906] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51825 { label="Project"; 22907 [labelType="html" label="MapPartitionsRDD [22907] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51824 { label="Project"; 22908 [labelType="html" label="MapPartitionsRDD [22908] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51823 { label="Project"; 22909 [labelType="html" label="MapPartitionsRDD [22909] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51822 { label="Project"; 22910 [labelType="html" label="MapPartitionsRDD [22910] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51821 { label="Project"; 22911 [labelType="html" label="MapPartitionsRDD [22911] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51839 { label="Scan parquet "; 22912 [labelType="html" label="FileScanRDD [22912]<br>rdd at PersistJob.java:21"]; 22913 [labelType="html" label="MapPartitionsRDD [22913]<br>rdd at PersistJob.java:21"]; } subgraph cluster51834 { label="WholeStageCodegen (20)"; 22914 [labelType="html" label="MapPartitionsRDD [22914]<br>rdd at PersistJob.java:21"]; } subgraph cluster51812 { label="Union"; 22915 [labelType="html" label="UnionRDD [22915] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster51811 { label="Exchange"; 22916 [labelType="html" label="MapPartitionsRDD [22916] [Unordered]<br>rdd at PersistJob.java:21"]; 22917 [labelType="html" label="MapPartitionsRDD [22917] [Unordered]<br>rdd at PersistJob.java:21"]; 22918 [labelType="html" label="MapPartitionsRDD [22918] [Unordered]<br>rdd at PersistJob.java:21"]; } } 22903->22904; 22904->22905; 22905->22906; 22906->22907; 22907->22908; 22908->22909; 22909->22910; 22910->22911; 22912->22913; 22913->22914; 22911->22915; 22914->22915; 22915->22916; 22916->22917; 22917->22918; }
22902,22903
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time