3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7694 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
45 s
Locality Level Summary:
Any: 10
Output Size / Records:
18.7 MiB / 259485
Shuffle Read Size / Records:
69.2 MiB / 259485
Associated Job Ids:
3721
DAG Visualization
digraph G { subgraph clusterstage_7694 { label="Stage 7694"; subgraph cluster49448 { label="Exchange"; 21796 [labelType="html" label="ShuffledRowRDD [21796] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49444 { label="WholeStageCodegen (25)"; 21797 [labelType="html" label="MapPartitionsRDD [21797] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49443 { label="Window"; 21798 [labelType="html" label="MapPartitionsRDD [21798] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49440 { label="WholeStageCodegen (26)"; 21799 [labelType="html" label="MapPartitionsRDD [21799] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49439 { label="Window"; 21800 [labelType="html" label="MapPartitionsRDD [21800] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49436 { label="WholeStageCodegen (27)"; 21801 [labelType="html" label="MapPartitionsRDD [21801] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49435 { label="Window"; 21802 [labelType="html" label="MapPartitionsRDD [21802] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49432 { label="WholeStageCodegen (28)"; 21803 [labelType="html" label="MapPartitionsRDD [21803] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49431 { label="Window"; 21804 [labelType="html" label="MapPartitionsRDD [21804] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49428 { label="WholeStageCodegen (29)"; 21805 [labelType="html" label="MapPartitionsRDD [21805] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49427 { label="WriteFiles"; 21806 [labelType="html" label="MapPartitionsRDD [21806] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21796->21797; 21797->21798; 21798->21799; 21799->21800; 21800->21801; 21801->21802; 21802->21803; 21803->21804; 21804->21805; 21805->21806; }
21795,21796
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time