3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15750 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
23 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231133
Shuffle Read Size / Records:
2.6 KiB / 10
Shuffle Write Size / Records:
2.5 KiB / 31
Associated Job Ids:
7981
DAG Visualization
digraph G { subgraph clusterstage_15750 { label="Stage 15750"; subgraph cluster103058 { label="Scan parquet "; 44094 [labelType="html" label="FileScanRDD [44094]<br>rdd at PersistJob.java:28"]; 44095 [labelType="html" label="MapPartitionsRDD [44095]<br>rdd at PersistJob.java:28"]; } subgraph cluster103053 { label="WholeStageCodegen (43)"; 44096 [labelType="html" label="MapPartitionsRDD [44096]<br>rdd at PersistJob.java:28"]; } subgraph cluster103061 { label="Exchange"; 44097 [labelType="html" label="ShuffledRowRDD [44097] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103059 { label="ObjectHashAggregate"; 44098 [labelType="html" label="MapPartitionsRDD [44098] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103052 { label="CartesianProduct"; 44099 [labelType="html" label="UnsafeCartesianRDD [44099] [Unordered]<br>rdd at PersistJob.java:28"]; 44100 [labelType="html" label="MapPartitionsRDD [44100] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103066 { label="Scan csv "; 44101 [labelType="html" label="FileScanRDD [44101]<br>rdd at PersistJob.java:28"]; 44102 [labelType="html" label="MapPartitionsRDD [44102]<br>rdd at PersistJob.java:28"]; } subgraph cluster103062 { label="WholeStageCodegen (44)"; 44103 [labelType="html" label="MapPartitionsRDD [44103]<br>rdd at PersistJob.java:28"]; } subgraph cluster103051 { label="CartesianProduct"; 44104 [labelType="html" label="UnsafeCartesianRDD [44104] [Unordered]<br>rdd at PersistJob.java:28"]; 44105 [labelType="html" label="MapPartitionsRDD [44105] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103047 { label="WholeStageCodegen (45)"; 44106 [labelType="html" label="MapPartitionsRDD [44106] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103046 { label="ObjectHashAggregate"; 44107 [labelType="html" label="MapPartitionsRDD [44107] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103045 { label="Exchange"; 44108 [labelType="html" label="MapPartitionsRDD [44108] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44094->44095; 44095->44096; 44097->44098; 44096->44099; 44098->44099; 44099->44100; 44101->44102; 44102->44103; 44100->44104; 44103->44104; 44104->44105; 44105->44106; 44106->44107; 44107->44108; }
43969,44097
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time