3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17083 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
28 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
97.9 MiB / 2124462
Shuffle Read Size / Records:
11.4 MiB / 261221
Associated Job Ids:
8323
DAG Visualization
digraph G { subgraph clusterstage_17083 { label="Stage 17083"; subgraph cluster109522 { label="Exchange"; 46827 [labelType="html" label="ShuffledRowRDD [46827] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109518 { label="WholeStageCodegen (18)"; 46828 [labelType="html" label="MapPartitionsRDD [46828] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109517 { label="Window"; 46829 [labelType="html" label="MapPartitionsRDD [46829] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109515 { label="Filter"; 46830 [labelType="html" label="MapPartitionsRDD [46830] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109514 { label="Project"; 46831 [labelType="html" label="MapPartitionsRDD [46831] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109513 { label="Project"; 46832 [labelType="html" label="MapPartitionsRDD [46832] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109512 { label="Project"; 46833 [labelType="html" label="MapPartitionsRDD [46833] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109511 { label="Project"; 46834 [labelType="html" label="MapPartitionsRDD [46834] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109510 { label="Project"; 46835 [labelType="html" label="MapPartitionsRDD [46835] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109528 { label="Scan parquet "; 46836 [labelType="html" label="FileScanRDD [46836]<br>rdd at PersistJob.java:21"]; 46837 [labelType="html" label="MapPartitionsRDD [46837]<br>rdd at PersistJob.java:21"]; } subgraph cluster109523 { label="WholeStageCodegen (20)"; 46838 [labelType="html" label="MapPartitionsRDD [46838]<br>rdd at PersistJob.java:21"]; } subgraph cluster109501 { label="Union"; 46839 [labelType="html" label="UnionRDD [46839] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster109500 { label="Exchange"; 46840 [labelType="html" label="MapPartitionsRDD [46840] [Unordered]<br>rdd at PersistJob.java:21"]; 46841 [labelType="html" label="MapPartitionsRDD [46841] [Unordered]<br>rdd at PersistJob.java:21"]; 46842 [labelType="html" label="MapPartitionsRDD [46842] [Unordered]<br>rdd at PersistJob.java:21"]; } } 46827->46828; 46828->46829; 46829->46830; 46830->46831; 46831->46832; 46832->46833; 46833->46834; 46834->46835; 46836->46837; 46837->46838; 46835->46839; 46838->46839; 46839->46840; 46840->46841; 46841->46842; }
46826,46827
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time