3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15834 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
10 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.5 MiB / 2231133
Shuffle Read Size / Records:
3.4 KiB / 10
Shuffle Write Size / Records:
4.9 KiB / 99
Associated Job Ids:
8007
DAG Visualization
digraph G { subgraph clusterstage_15834 { label="Stage 15834"; subgraph cluster103491 { label="Scan parquet "; 44340 [labelType="html" label="FileScanRDD [44340]<br>parquet at PersistJob.java:35"]; 44341 [labelType="html" label="MapPartitionsRDD [44341]<br>parquet at PersistJob.java:35"]; } subgraph cluster103486 { label="WholeStageCodegen (34)"; 44342 [labelType="html" label="MapPartitionsRDD [44342]<br>parquet at PersistJob.java:35"]; } subgraph cluster103494 { label="Exchange"; 44343 [labelType="html" label="ShuffledRowRDD [44343] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103492 { label="ObjectHashAggregate"; 44344 [labelType="html" label="MapPartitionsRDD [44344] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103485 { label="CartesianProduct"; 44345 [labelType="html" label="UnsafeCartesianRDD [44345] [Unordered]<br>parquet at PersistJob.java:35"]; 44346 [labelType="html" label="MapPartitionsRDD [44346] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103499 { label="Scan csv "; 44347 [labelType="html" label="FileScanRDD [44347]<br>parquet at PersistJob.java:35"]; 44348 [labelType="html" label="MapPartitionsRDD [44348]<br>parquet at PersistJob.java:35"]; } subgraph cluster103495 { label="WholeStageCodegen (35)"; 44349 [labelType="html" label="MapPartitionsRDD [44349]<br>parquet at PersistJob.java:35"]; } subgraph cluster103484 { label="CartesianProduct"; 44350 [labelType="html" label="UnsafeCartesianRDD [44350] [Unordered]<br>parquet at PersistJob.java:35"]; 44351 [labelType="html" label="MapPartitionsRDD [44351] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103480 { label="WholeStageCodegen (36)"; 44352 [labelType="html" label="MapPartitionsRDD [44352] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103479 { label="ObjectHashAggregate"; 44353 [labelType="html" label="MapPartitionsRDD [44353] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103478 { label="Exchange"; 44354 [labelType="html" label="MapPartitionsRDD [44354] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44340->44341; 44341->44342; 44343->44344; 44342->44345; 44344->44345; 44345->44346; 44347->44348; 44348->44349; 44346->44350; 44349->44350; 44350->44351; 44351->44352; 44352->44353; 44353->44354; }
44240,44343
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time