3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7788 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
799.0 KiB / 76289
Shuffle Write Size / Records:
704.5 KiB / 76289
Associated Job Ids:
3798
DAG Visualization
digraph G { subgraph clusterstage_7788 { label="Stage 7788"; subgraph cluster50515 { label="AQEShuffleRead"; 22348 [labelType="html" label="ShuffledRowRDD [22348] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50512 { label="WholeStageCodegen (4)"; 22349 [labelType="html" label="MapPartitionsRDD [22349] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50511 { label="Window"; 22353 [labelType="html" label="MapPartitionsRDD [22353] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50507 { label="WholeStageCodegen (5)"; 22354 [labelType="html" label="MapPartitionsRDD [22354] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50525 { label="Scan csv "; 22357 [labelType="html" label="FileScanRDD [22357]<br>parquet at PersistJob.java:35"]; 22358 [labelType="html" label="MapPartitionsRDD [22358]<br>parquet at PersistJob.java:35"]; } subgraph cluster50521 { label="WholeStageCodegen (6)"; 22361 [labelType="html" label="MapPartitionsRDD [22361]<br>parquet at PersistJob.java:35"]; } subgraph cluster50506 { label="CartesianProduct"; 22363 [labelType="html" label="UnsafeCartesianRDD [22363] [Unordered]<br>parquet at PersistJob.java:35"]; 22364 [labelType="html" label="MapPartitionsRDD [22364] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50503 { label="WholeStageCodegen (7)"; 22365 [labelType="html" label="MapPartitionsRDD [22365] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50502 { label="Exchange"; 22367 [labelType="html" label="MapPartitionsRDD [22367] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22348->22349; 22349->22353; 22353->22354; 22357->22358; 22358->22361; 22354->22363; 22361->22363; 22363->22364; 22364->22365; 22365->22367; }
22325,22348
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time