3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32556 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Input Size / Records:
163.0 B / 1
Shuffle Read Size / Records:
1113.4 KiB / 87452
Shuffle Write Size / Records:
1083.8 KiB / 87452
Associated Job Ids:
17935
DAG Visualization
digraph G { subgraph clusterstage_32556 { label="Stage 32556"; subgraph cluster207408 { label="AQEShuffleRead"; 89776 [labelType="html" label="ShuffledRowRDD [89776] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207405 { label="WholeStageCodegen (4)"; 89777 [labelType="html" label="MapPartitionsRDD [89777] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207404 { label="Window"; 89778 [labelType="html" label="MapPartitionsRDD [89778] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207400 { label="WholeStageCodegen (5)"; 89779 [labelType="html" label="MapPartitionsRDD [89779] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207413 { label="Scan csv "; 89780 [labelType="html" label="FileScanRDD [89780]<br>parquet at PersistJob.java:35"]; 89781 [labelType="html" label="MapPartitionsRDD [89781]<br>parquet at PersistJob.java:35"]; } subgraph cluster207409 { label="WholeStageCodegen (6)"; 89782 [labelType="html" label="MapPartitionsRDD [89782]<br>parquet at PersistJob.java:35"]; } subgraph cluster207399 { label="CartesianProduct"; 89783 [labelType="html" label="UnsafeCartesianRDD [89783] [Unordered]<br>parquet at PersistJob.java:35"]; 89784 [labelType="html" label="MapPartitionsRDD [89784] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207396 { label="WholeStageCodegen (7)"; 89785 [labelType="html" label="MapPartitionsRDD [89785] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207395 { label="Exchange"; 89786 [labelType="html" label="MapPartitionsRDD [89786] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89776->89777; 89777->89778; 89778->89779; 89780->89781; 89781->89782; 89779->89783; 89782->89783; 89783->89784; 89784->89785; 89785->89786; }
89753,89776
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time