3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7750 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
952.6 KiB / 76289
Shuffle Write Size / Records:
873.9 KiB / 76289
Associated Job Ids:
3772
DAG Visualization
digraph G { subgraph clusterstage_7750 { label="Stage 7750"; subgraph cluster50049 { label="AQEShuffleRead"; 22121 [labelType="html" label="ShuffledRowRDD [22121] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50046 { label="WholeStageCodegen (4)"; 22122 [labelType="html" label="MapPartitionsRDD [22122] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50045 { label="Window"; 22123 [labelType="html" label="MapPartitionsRDD [22123] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50041 { label="WholeStageCodegen (5)"; 22124 [labelType="html" label="MapPartitionsRDD [22124] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50054 { label="Scan csv "; 22125 [labelType="html" label="FileScanRDD [22125]<br>parquet at PersistJob.java:35"]; 22126 [labelType="html" label="MapPartitionsRDD [22126]<br>parquet at PersistJob.java:35"]; } subgraph cluster50050 { label="WholeStageCodegen (6)"; 22127 [labelType="html" label="MapPartitionsRDD [22127]<br>parquet at PersistJob.java:35"]; } subgraph cluster50040 { label="CartesianProduct"; 22128 [labelType="html" label="UnsafeCartesianRDD [22128] [Unordered]<br>parquet at PersistJob.java:35"]; 22129 [labelType="html" label="MapPartitionsRDD [22129] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50037 { label="WholeStageCodegen (7)"; 22130 [labelType="html" label="MapPartitionsRDD [22130] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50036 { label="Exchange"; 22131 [labelType="html" label="MapPartitionsRDD [22131] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22121->22122; 22122->22123; 22123->22124; 22125->22126; 22126->22127; 22124->22128; 22127->22128; 22128->22129; 22129->22130; 22130->22131; }
22090,22121
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time