3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16922 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
799.0 KiB / 76289
Shuffle Write Size / Records:
704.5 KiB / 76289
Associated Job Ids:
8230
DAG Visualization
digraph G { subgraph clusterstage_16922 { label="Stage 16922"; subgraph cluster108099 { label="AQEShuffleRead"; 46205 [labelType="html" label="ShuffledRowRDD [46205] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108096 { label="WholeStageCodegen (4)"; 46206 [labelType="html" label="MapPartitionsRDD [46206] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108095 { label="Window"; 46207 [labelType="html" label="MapPartitionsRDD [46207] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108091 { label="WholeStageCodegen (5)"; 46208 [labelType="html" label="MapPartitionsRDD [46208] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108104 { label="Scan csv "; 46209 [labelType="html" label="FileScanRDD [46209]<br>rdd at PersistJob.java:28"]; 46210 [labelType="html" label="MapPartitionsRDD [46210]<br>rdd at PersistJob.java:28"]; } subgraph cluster108100 { label="WholeStageCodegen (6)"; 46212 [labelType="html" label="MapPartitionsRDD [46212]<br>rdd at PersistJob.java:28"]; } subgraph cluster108090 { label="CartesianProduct"; 46213 [labelType="html" label="UnsafeCartesianRDD [46213] [Unordered]<br>rdd at PersistJob.java:28"]; 46214 [labelType="html" label="MapPartitionsRDD [46214] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108087 { label="WholeStageCodegen (7)"; 46215 [labelType="html" label="MapPartitionsRDD [46215] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster108086 { label="Exchange"; 46216 [labelType="html" label="MapPartitionsRDD [46216] [Unordered]<br>rdd at PersistJob.java:28"]; } } 46205->46206; 46206->46207; 46207->46208; 46209->46210; 46210->46212; 46208->46213; 46212->46213; 46213->46214; 46214->46215; 46215->46216; }
46183,46205
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time