3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15752 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
21 s
Locality Level Summary:
Any: 10
Input Size / Records:
92.4 MiB / 2231133
Shuffle Read Size / Records:
460.0 B / 10
Shuffle Write Size / Records:
8.5 MiB / 256548
Associated Job Ids:
7982
DAG Visualization
digraph G { subgraph clusterstage_15752 { label="Stage 15752"; subgraph cluster103081 { label="Scan parquet "; 44109 [labelType="html" label="FileScanRDD [44109]<br>rdd at PersistJob.java:28"]; 44110 [labelType="html" label="MapPartitionsRDD [44110]<br>rdd at PersistJob.java:28"]; } subgraph cluster103076 { label="WholeStageCodegen (46)"; 44111 [labelType="html" label="MapPartitionsRDD [44111]<br>rdd at PersistJob.java:28"]; } subgraph cluster103086 { label="Scan csv "; 44112 [labelType="html" label="FileScanRDD [44112]<br>rdd at PersistJob.java:28"]; 44113 [labelType="html" label="MapPartitionsRDD [44113]<br>rdd at PersistJob.java:28"]; } subgraph cluster103082 { label="WholeStageCodegen (47)"; 44114 [labelType="html" label="MapPartitionsRDD [44114]<br>rdd at PersistJob.java:28"]; } subgraph cluster103075 { label="CartesianProduct"; 44115 [labelType="html" label="UnsafeCartesianRDD [44115]<br>rdd at PersistJob.java:28"]; 44116 [labelType="html" label="MapPartitionsRDD [44116]<br>rdd at PersistJob.java:28"]; } subgraph cluster103072 { label="WholeStageCodegen (48)"; 44117 [labelType="html" label="MapPartitionsRDD [44117]<br>rdd at PersistJob.java:28"]; } subgraph cluster103091 { label="Exchange"; 44118 [labelType="html" label="ShuffledRowRDD [44118] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103087 { label="WholeStageCodegen (49)"; 44119 [labelType="html" label="MapPartitionsRDD [44119] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103071 { label="CartesianProduct"; 44120 [labelType="html" label="UnsafeCartesianRDD [44120] [Unordered]<br>rdd at PersistJob.java:28"]; 44121 [labelType="html" label="MapPartitionsRDD [44121] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103068 { label="WholeStageCodegen (50)"; 44122 [labelType="html" label="MapPartitionsRDD [44122] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103067 { label="Exchange"; 44123 [labelType="html" label="MapPartitionsRDD [44123] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44109->44110; 44110->44111; 44112->44113; 44113->44114; 44111->44115; 44114->44115; 44115->44116; 44116->44117; 44118->44119; 44117->44120; 44119->44120; 44120->44121; 44121->44122; 44122->44123; }
43984,44118
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time