3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16908 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
952.6 KiB / 76289
Shuffle Write Size / Records:
873.9 KiB / 76289
Associated Job Ids:
8220
DAG Visualization
digraph G { subgraph clusterstage_16908 { label="Stage 16908"; subgraph cluster107942 { label="AQEShuffleRead"; 46124 [labelType="html" label="ShuffledRowRDD [46124] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107939 { label="WholeStageCodegen (4)"; 46125 [labelType="html" label="MapPartitionsRDD [46125] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107938 { label="Window"; 46126 [labelType="html" label="MapPartitionsRDD [46126] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107934 { label="WholeStageCodegen (5)"; 46127 [labelType="html" label="MapPartitionsRDD [46127] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107956 { label="Scan csv "; 46142 [labelType="html" label="FileScanRDD [46142]<br>parquet at PersistJob.java:35"]; 46143 [labelType="html" label="MapPartitionsRDD [46143]<br>parquet at PersistJob.java:35"]; } subgraph cluster107943 { label="WholeStageCodegen (6)"; 46144 [labelType="html" label="MapPartitionsRDD [46144]<br>parquet at PersistJob.java:35"]; } subgraph cluster107933 { label="CartesianProduct"; 46145 [labelType="html" label="UnsafeCartesianRDD [46145] [Unordered]<br>parquet at PersistJob.java:35"]; 46146 [labelType="html" label="MapPartitionsRDD [46146] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107930 { label="WholeStageCodegen (7)"; 46147 [labelType="html" label="MapPartitionsRDD [46147] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster107929 { label="Exchange"; 46148 [labelType="html" label="MapPartitionsRDD [46148] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46124->46125; 46125->46126; 46126->46127; 46142->46143; 46143->46144; 46127->46145; 46144->46145; 46145->46146; 46146->46147; 46147->46148; }
46090,46124
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time