3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15748 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
20 s
Locality Level Summary:
Any: 10
Input Size / Records:
14.5 MiB / 2231133
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
7980
DAG Visualization
digraph G { subgraph clusterstage_15748 { label="Stage 15748"; subgraph cluster103036 { label="Scan parquet "; 44079 [labelType="html" label="FileScanRDD [44079]<br>rdd at PersistJob.java:28"]; 44080 [labelType="html" label="MapPartitionsRDD [44080]<br>rdd at PersistJob.java:28"]; } subgraph cluster103031 { label="WholeStageCodegen (40)"; 44081 [labelType="html" label="MapPartitionsRDD [44081]<br>rdd at PersistJob.java:28"]; } subgraph cluster103039 { label="Exchange"; 44082 [labelType="html" label="ShuffledRowRDD [44082] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103037 { label="ObjectHashAggregate"; 44083 [labelType="html" label="MapPartitionsRDD [44083] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103030 { label="CartesianProduct"; 44084 [labelType="html" label="UnsafeCartesianRDD [44084] [Unordered]<br>rdd at PersistJob.java:28"]; 44085 [labelType="html" label="MapPartitionsRDD [44085] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103044 { label="Scan csv "; 44086 [labelType="html" label="FileScanRDD [44086]<br>rdd at PersistJob.java:28"]; 44087 [labelType="html" label="MapPartitionsRDD [44087]<br>rdd at PersistJob.java:28"]; } subgraph cluster103040 { label="WholeStageCodegen (41)"; 44088 [labelType="html" label="MapPartitionsRDD [44088]<br>rdd at PersistJob.java:28"]; } subgraph cluster103029 { label="CartesianProduct"; 44089 [labelType="html" label="UnsafeCartesianRDD [44089] [Unordered]<br>rdd at PersistJob.java:28"]; 44090 [labelType="html" label="MapPartitionsRDD [44090] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103025 { label="WholeStageCodegen (42)"; 44091 [labelType="html" label="MapPartitionsRDD [44091] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103024 { label="ObjectHashAggregate"; 44092 [labelType="html" label="MapPartitionsRDD [44092] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103023 { label="Exchange"; 44093 [labelType="html" label="MapPartitionsRDD [44093] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44079->44080; 44080->44081; 44082->44083; 44081->44084; 44083->44084; 44084->44085; 44086->44087; 44087->44088; 44085->44089; 44088->44089; 44089->44090; 44090->44091; 44091->44092; 44092->44093; }
43959,44082
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time