3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7798 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 10
Output Size / Records:
112.9 KiB / 1333
Shuffle Read Size / Records:
24.8 MiB / 1375441
Associated Job Ids:
3802
DAG Visualization
digraph G { subgraph clusterstage_7798 { label="Stage 7798"; subgraph cluster50588 { label="Exchange"; 22385 [labelType="html" label="ShuffledRowRDD [22385] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50584 { label="WholeStageCodegen (5)"; 22386 [labelType="html" label="MapPartitionsRDD [22386] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50583 { label="Window"; 22387 [labelType="html" label="MapPartitionsRDD [22387] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50579 { label="WholeStageCodegen (6)"; 22388 [labelType="html" label="MapPartitionsRDD [22388] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50594 { label="Exchange"; 22389 [labelType="html" label="ShuffledRowRDD [22389] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50590 { label="WholeStageCodegen (7)"; 22390 [labelType="html" label="MapPartitionsRDD [22390] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50574 { label="WholeStageCodegen (8)"; 22391 [labelType="html" label="ZippedPartitionsRDD2 [22391] [Unordered]<br>parquet at PersistJob.java:35"]; 22392 [labelType="html" label="MapPartitionsRDD [22392] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50573 { label="Window"; 22393 [labelType="html" label="MapPartitionsRDD [22393] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50560 { label="WholeStageCodegen (9)"; 22394 [labelType="html" label="MapPartitionsRDD [22394] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50559 { label="WriteFiles"; 22395 [labelType="html" label="MapPartitionsRDD [22395] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22385->22386; 22386->22387; 22387->22388; 22389->22390; 22388->22391; 22390->22391; 22391->22392; 22392->22393; 22393->22394; 22394->22395; }
22368,22385
22372,22389
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time