3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15840 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231133
Shuffle Read Size / Records:
2.6 KiB / 10
Shuffle Write Size / Records:
2.5 KiB / 31
Associated Job Ids:
8010
DAG Visualization
digraph G { subgraph clusterstage_15840 { label="Stage 15840"; subgraph cluster103557 { label="Scan parquet "; 44385 [labelType="html" label="FileScanRDD [44385]<br>parquet at PersistJob.java:35"]; 44386 [labelType="html" label="MapPartitionsRDD [44386]<br>parquet at PersistJob.java:35"]; } subgraph cluster103552 { label="WholeStageCodegen (43)"; 44387 [labelType="html" label="MapPartitionsRDD [44387]<br>parquet at PersistJob.java:35"]; } subgraph cluster103560 { label="Exchange"; 44388 [labelType="html" label="ShuffledRowRDD [44388] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103558 { label="ObjectHashAggregate"; 44389 [labelType="html" label="MapPartitionsRDD [44389] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103551 { label="CartesianProduct"; 44390 [labelType="html" label="UnsafeCartesianRDD [44390] [Unordered]<br>parquet at PersistJob.java:35"]; 44391 [labelType="html" label="MapPartitionsRDD [44391] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103565 { label="Scan csv "; 44392 [labelType="html" label="FileScanRDD [44392]<br>parquet at PersistJob.java:35"]; 44393 [labelType="html" label="MapPartitionsRDD [44393]<br>parquet at PersistJob.java:35"]; } subgraph cluster103561 { label="WholeStageCodegen (44)"; 44394 [labelType="html" label="MapPartitionsRDD [44394]<br>parquet at PersistJob.java:35"]; } subgraph cluster103550 { label="CartesianProduct"; 44395 [labelType="html" label="UnsafeCartesianRDD [44395] [Unordered]<br>parquet at PersistJob.java:35"]; 44396 [labelType="html" label="MapPartitionsRDD [44396] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103546 { label="WholeStageCodegen (45)"; 44397 [labelType="html" label="MapPartitionsRDD [44397] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103545 { label="ObjectHashAggregate"; 44398 [labelType="html" label="MapPartitionsRDD [44398] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103544 { label="Exchange"; 44399 [labelType="html" label="MapPartitionsRDD [44399] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44385->44386; 44386->44387; 44388->44389; 44387->44390; 44389->44390; 44390->44391; 44392->44393; 44393->44394; 44391->44395; 44394->44395; 44395->44396; 44396->44397; 44397->44398; 44398->44399; }
44260,44388
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time