3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32543 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Input Size / Records:
163.0 B / 1
Shuffle Read Size / Records:
1113.4 KiB / 87452
Shuffle Write Size / Records:
1083.8 KiB / 87452
Associated Job Ids:
17926
DAG Visualization
digraph G { subgraph clusterstage_32543 { label="Stage 32543"; subgraph cluster207234 { label="AQEShuffleRead"; 89711 [labelType="html" label="ShuffledRowRDD [89711] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207231 { label="WholeStageCodegen (4)"; 89712 [labelType="html" label="MapPartitionsRDD [89712] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207230 { label="Window"; 89713 [labelType="html" label="MapPartitionsRDD [89713] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207226 { label="WholeStageCodegen (5)"; 89714 [labelType="html" label="MapPartitionsRDD [89714] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207239 { label="Scan csv "; 89715 [labelType="html" label="FileScanRDD [89715]<br>rdd at PersistJob.java:28"]; 89716 [labelType="html" label="MapPartitionsRDD [89716]<br>rdd at PersistJob.java:28"]; } subgraph cluster207235 { label="WholeStageCodegen (6)"; 89717 [labelType="html" label="MapPartitionsRDD [89717]<br>rdd at PersistJob.java:28"]; } subgraph cluster207225 { label="CartesianProduct"; 89718 [labelType="html" label="UnsafeCartesianRDD [89718] [Unordered]<br>rdd at PersistJob.java:28"]; 89719 [labelType="html" label="MapPartitionsRDD [89719] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207222 { label="WholeStageCodegen (7)"; 89720 [labelType="html" label="MapPartitionsRDD [89720] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207221 { label="Exchange"; 89721 [labelType="html" label="MapPartitionsRDD [89721] [Unordered]<br>rdd at PersistJob.java:28"]; } } 89711->89712; 89712->89713; 89713->89714; 89715->89716; 89716->89717; 89714->89718; 89717->89718; 89718->89719; 89719->89720; 89720->89721; }
89700,89711
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time