3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15830 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 10
Input Size / Records:
16.3 MiB / 2231133
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
3.9 KiB / 78
Associated Job Ids:
8005
DAG Visualization
digraph G { subgraph clusterstage_15830 { label="Stage 15830"; subgraph cluster103447 { label="Scan parquet "; 44310 [labelType="html" label="FileScanRDD [44310]<br>parquet at PersistJob.java:35"]; 44311 [labelType="html" label="MapPartitionsRDD [44311]<br>parquet at PersistJob.java:35"]; } subgraph cluster103442 { label="WholeStageCodegen (28)"; 44312 [labelType="html" label="MapPartitionsRDD [44312]<br>parquet at PersistJob.java:35"]; } subgraph cluster103450 { label="Exchange"; 44313 [labelType="html" label="ShuffledRowRDD [44313] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103448 { label="ObjectHashAggregate"; 44314 [labelType="html" label="MapPartitionsRDD [44314] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103441 { label="CartesianProduct"; 44315 [labelType="html" label="UnsafeCartesianRDD [44315] [Unordered]<br>parquet at PersistJob.java:35"]; 44316 [labelType="html" label="MapPartitionsRDD [44316] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103455 { label="Scan csv "; 44317 [labelType="html" label="FileScanRDD [44317]<br>parquet at PersistJob.java:35"]; 44318 [labelType="html" label="MapPartitionsRDD [44318]<br>parquet at PersistJob.java:35"]; } subgraph cluster103451 { label="WholeStageCodegen (29)"; 44319 [labelType="html" label="MapPartitionsRDD [44319]<br>parquet at PersistJob.java:35"]; } subgraph cluster103440 { label="CartesianProduct"; 44320 [labelType="html" label="UnsafeCartesianRDD [44320] [Unordered]<br>parquet at PersistJob.java:35"]; 44321 [labelType="html" label="MapPartitionsRDD [44321] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103436 { label="WholeStageCodegen (30)"; 44322 [labelType="html" label="MapPartitionsRDD [44322] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103435 { label="ObjectHashAggregate"; 44323 [labelType="html" label="MapPartitionsRDD [44323] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103434 { label="Exchange"; 44324 [labelType="html" label="MapPartitionsRDD [44324] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44310->44311; 44311->44312; 44313->44314; 44312->44315; 44314->44315; 44315->44316; 44317->44318; 44318->44319; 44316->44320; 44319->44320; 44320->44321; 44321->44322; 44322->44323; 44323->44324; }
44230,44313
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time