3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15746 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231123
Shuffle Read Size / Records:
2.7 KiB / 10
Associated Job Ids:
7979
DAG Visualization
digraph G { subgraph clusterstage_15746 { label="Stage 15746"; subgraph cluster103014 { label="Scan parquet "; 44064 [labelType="html" label="FileScanRDD [44064]<br>rdd at PersistJob.java:28"]; 44065 [labelType="html" label="MapPartitionsRDD [44065]<br>rdd at PersistJob.java:28"]; } subgraph cluster103009 { label="WholeStageCodegen (37)"; 44066 [labelType="html" label="MapPartitionsRDD [44066]<br>rdd at PersistJob.java:28"]; } subgraph cluster103017 { label="Exchange"; 44067 [labelType="html" label="ShuffledRowRDD [44067] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103015 { label="ObjectHashAggregate"; 44068 [labelType="html" label="MapPartitionsRDD [44068] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103008 { label="CartesianProduct"; 44069 [labelType="html" label="UnsafeCartesianRDD [44069] [Unordered]<br>rdd at PersistJob.java:28"]; 44070 [labelType="html" label="MapPartitionsRDD [44070] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103022 { label="Scan csv "; 44071 [labelType="html" label="FileScanRDD [44071]<br>rdd at PersistJob.java:28"]; 44072 [labelType="html" label="MapPartitionsRDD [44072]<br>rdd at PersistJob.java:28"]; } subgraph cluster103018 { label="WholeStageCodegen (38)"; 44073 [labelType="html" label="MapPartitionsRDD [44073]<br>rdd at PersistJob.java:28"]; } subgraph cluster103007 { label="CartesianProduct"; 44074 [labelType="html" label="UnsafeCartesianRDD [44074] [Unordered]<br>rdd at PersistJob.java:28"]; 44075 [labelType="html" label="MapPartitionsRDD [44075] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103003 { label="WholeStageCodegen (39)"; 44076 [labelType="html" label="MapPartitionsRDD [44076] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103002 { label="ObjectHashAggregate"; 44077 [labelType="html" label="MapPartitionsRDD [44077] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103001 { label="Exchange"; 44078 [labelType="html" label="MapPartitionsRDD [44078] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44064->44065; 44065->44066; 44067->44068; 44066->44069; 44068->44069; 44069->44070; 44071->44072; 44072->44073; 44070->44074; 44073->44074; 44074->44075; 44075->44076; 44076->44077; 44077->44078; }
43954,44067
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time