3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16941 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
799.0 KiB / 76289
Shuffle Write Size / Records:
704.5 KiB / 76289
Associated Job Ids:
8243
DAG Visualization
digraph G { subgraph clusterstage_16941 { label="Stage 16941"; subgraph cluster108282 { label="AQEShuffleRead"; 46299 [labelType="html" label="ShuffledRowRDD [46299] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108279 { label="WholeStageCodegen (4)"; 46300 [labelType="html" label="MapPartitionsRDD [46300] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108278 { label="Window"; 46301 [labelType="html" label="MapPartitionsRDD [46301] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108274 { label="WholeStageCodegen (5)"; 46302 [labelType="html" label="MapPartitionsRDD [46302] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108287 { label="Scan csv "; 46303 [labelType="html" label="FileScanRDD [46303]<br>parquet at PersistJob.java:35"]; 46304 [labelType="html" label="MapPartitionsRDD [46304]<br>parquet at PersistJob.java:35"]; } subgraph cluster108283 { label="WholeStageCodegen (6)"; 46305 [labelType="html" label="MapPartitionsRDD [46305]<br>parquet at PersistJob.java:35"]; } subgraph cluster108273 { label="CartesianProduct"; 46306 [labelType="html" label="UnsafeCartesianRDD [46306] [Unordered]<br>parquet at PersistJob.java:35"]; 46307 [labelType="html" label="MapPartitionsRDD [46307] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108270 { label="WholeStageCodegen (7)"; 46308 [labelType="html" label="MapPartitionsRDD [46308] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108269 { label="Exchange"; 46309 [labelType="html" label="MapPartitionsRDD [46309] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46299->46300; 46300->46301; 46301->46302; 46303->46304; 46304->46305; 46302->46306; 46305->46306; 46306->46307; 46307->46308; 46308->46309; }
46283,46299
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time