3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12333 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Input Size / Records:
1481.0 B / 1
Shuffle Read Size / Records:
129.0 B / 1
Shuffle Write Size / Records:
76.0 B / 1
Associated Job Ids:
5317
DAG Visualization
digraph G { subgraph clusterstage_12333 { label="Stage 12333"; subgraph cluster71372 { label="AQEShuffleRead"; 30167 [labelType="html" label="ShuffledRowRDD [30167] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71369 { label="WholeStageCodegen (9)"; 30168 [labelType="html" label="MapPartitionsRDD [30168] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71368 { label="Window"; 30169 [labelType="html" label="MapPartitionsRDD [30169] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71365 { label="WholeStageCodegen (10)"; 30170 [labelType="html" label="MapPartitionsRDD [30170] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71364 { label="Window"; 30171 [labelType="html" label="MapPartitionsRDD [30171] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71360 { label="WholeStageCodegen (11)"; 30172 [labelType="html" label="MapPartitionsRDD [30172] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71376 { label="Scan parquet "; 30173 [labelType="html" label="FileScanRDD [30173]<br>count at ColumnStatJob.java:47"]; 30174 [labelType="html" label="MapPartitionsRDD [30174]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71373 { label="WholeStageCodegen (12)"; 30175 [labelType="html" label="MapPartitionsRDD [30175]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71359 { label="CartesianProduct"; 30176 [labelType="html" label="UnsafeCartesianRDD [30176] [Unordered]<br>count at ColumnStatJob.java:47"]; 30177 [labelType="html" label="MapPartitionsRDD [30177] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster71358 { label="Exchange"; 30178 [labelType="html" label="MapPartitionsRDD [30178] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 30167->30168; 30168->30169; 30169->30170; 30170->30171; 30171->30172; 30173->30174; 30174->30175; 30172->30176; 30175->30176; 30176->30177; 30177->30178; }
30166,30167
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time