3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15956 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
34 s
Locality Level Summary:
Any: 10
Output Size / Records:
11.5 MiB / 167745
Shuffle Read Size / Records:
44.7 MiB / 167745
Associated Job Ids:
7763
DAG Visualization
digraph G { subgraph clusterstage_15956 { label="Stage 15956"; subgraph cluster101448 { label="Exchange"; 43279 [labelType="html" label="ShuffledRowRDD [43279] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101444 { label="WholeStageCodegen (25)"; 43280 [labelType="html" label="MapPartitionsRDD [43280] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101443 { label="Window"; 43281 [labelType="html" label="MapPartitionsRDD [43281] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101440 { label="WholeStageCodegen (26)"; 43282 [labelType="html" label="MapPartitionsRDD [43282] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101439 { label="Window"; 43283 [labelType="html" label="MapPartitionsRDD [43283] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101436 { label="WholeStageCodegen (27)"; 43284 [labelType="html" label="MapPartitionsRDD [43284] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101435 { label="Window"; 43285 [labelType="html" label="MapPartitionsRDD [43285] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101432 { label="WholeStageCodegen (28)"; 43286 [labelType="html" label="MapPartitionsRDD [43286] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101431 { label="Window"; 43287 [labelType="html" label="MapPartitionsRDD [43287] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101428 { label="WholeStageCodegen (29)"; 43288 [labelType="html" label="MapPartitionsRDD [43288] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster101427 { label="WriteFiles"; 43289 [labelType="html" label="MapPartitionsRDD [43289] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43279->43280; 43280->43281; 43281->43282; 43282->43283; 43283->43284; 43284->43285; 43285->43286; 43286->43287; 43287->43288; 43288->43289; }
43278,43279
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time