3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16208 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
14 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 597670
Shuffle Read Size / Records:
8.3 MiB / 173748
Associated Job Ids:
7926
DAG Visualization
digraph G { subgraph clusterstage_16208 { label="Stage 16208"; subgraph cluster103928 { label="AQEShuffleRead"; 44411 [labelType="html" label="ShuffledRowRDD [44411] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103925 { label="WholeStageCodegen (18)"; 44412 [labelType="html" label="MapPartitionsRDD [44412] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103924 { label="Window"; 44413 [labelType="html" label="MapPartitionsRDD [44413] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103922 { label="Filter"; 44414 [labelType="html" label="MapPartitionsRDD [44414] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103921 { label="Project"; 44415 [labelType="html" label="MapPartitionsRDD [44415] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103920 { label="Project"; 44416 [labelType="html" label="MapPartitionsRDD [44416] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103919 { label="Project"; 44417 [labelType="html" label="MapPartitionsRDD [44417] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103918 { label="Project"; 44418 [labelType="html" label="MapPartitionsRDD [44418] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103917 { label="Project"; 44419 [labelType="html" label="MapPartitionsRDD [44419] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103934 { label="Scan parquet "; 44420 [labelType="html" label="FileScanRDD [44420]<br>rdd at PersistJob.java:21"]; 44421 [labelType="html" label="MapPartitionsRDD [44421]<br>rdd at PersistJob.java:21"]; } subgraph cluster103929 { label="WholeStageCodegen (20)"; 44422 [labelType="html" label="MapPartitionsRDD [44422]<br>rdd at PersistJob.java:21"]; } subgraph cluster103908 { label="Union"; 44423 [labelType="html" label="UnionRDD [44423] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster103907 { label="Exchange"; 44424 [labelType="html" label="MapPartitionsRDD [44424] [Unordered]<br>rdd at PersistJob.java:21"]; 44425 [labelType="html" label="MapPartitionsRDD [44425] [Unordered]<br>rdd at PersistJob.java:21"]; 44426 [labelType="html" label="MapPartitionsRDD [44426] [Unordered]<br>rdd at PersistJob.java:21"]; } } 44411->44412; 44412->44413; 44413->44414; 44414->44415; 44415->44416; 44416->44417; 44417->44418; 44418->44419; 44420->44421; 44421->44422; 44419->44423; 44422->44423; 44423->44424; 44424->44425; 44425->44426; }
44410,44411
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time