3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15140 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
481.2 KiB / 45934
Shuffle Write Size / Records:
419.5 KiB / 45934
Associated Job Ids:
7970
DAG Visualization
digraph G { subgraph clusterstage_15140 { label="Stage 15140"; subgraph cluster97543 { label="AQEShuffleRead"; 41208 [labelType="html" label="ShuffledRowRDD [41208] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97540 { label="WholeStageCodegen (4)"; 41211 [labelType="html" label="MapPartitionsRDD [41211] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97539 { label="Window"; 41214 [labelType="html" label="MapPartitionsRDD [41214] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97535 { label="WholeStageCodegen (5)"; 41215 [labelType="html" label="MapPartitionsRDD [41215] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97553 { label="Scan csv "; 41216 [labelType="html" label="FileScanRDD [41216]<br>parquet at PersistJob.java:35"]; 41217 [labelType="html" label="MapPartitionsRDD [41217]<br>parquet at PersistJob.java:35"]; } subgraph cluster97549 { label="WholeStageCodegen (6)"; 41218 [labelType="html" label="MapPartitionsRDD [41218]<br>parquet at PersistJob.java:35"]; } subgraph cluster97534 { label="CartesianProduct"; 41219 [labelType="html" label="UnsafeCartesianRDD [41219] [Unordered]<br>parquet at PersistJob.java:35"]; 41220 [labelType="html" label="MapPartitionsRDD [41220] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97531 { label="WholeStageCodegen (7)"; 41221 [labelType="html" label="MapPartitionsRDD [41221] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster97530 { label="Exchange"; 41224 [labelType="html" label="MapPartitionsRDD [41224] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41208->41211; 41211->41214; 41214->41215; 41216->41217; 41217->41218; 41215->41219; 41218->41219; 41219->41220; 41220->41221; 41221->41224; }
41194,41208
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time