3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15836 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231123
Shuffle Read Size / Records:
2.7 KiB / 10
Associated Job Ids:
8008
DAG Visualization
digraph G { subgraph clusterstage_15836 { label="Stage 15836"; subgraph cluster103513 { label="Scan parquet "; 44355 [labelType="html" label="FileScanRDD [44355]<br>parquet at PersistJob.java:35"]; 44356 [labelType="html" label="MapPartitionsRDD [44356]<br>parquet at PersistJob.java:35"]; } subgraph cluster103508 { label="WholeStageCodegen (37)"; 44357 [labelType="html" label="MapPartitionsRDD [44357]<br>parquet at PersistJob.java:35"]; } subgraph cluster103516 { label="Exchange"; 44358 [labelType="html" label="ShuffledRowRDD [44358] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103514 { label="ObjectHashAggregate"; 44359 [labelType="html" label="MapPartitionsRDD [44359] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103507 { label="CartesianProduct"; 44360 [labelType="html" label="UnsafeCartesianRDD [44360] [Unordered]<br>parquet at PersistJob.java:35"]; 44361 [labelType="html" label="MapPartitionsRDD [44361] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103521 { label="Scan csv "; 44362 [labelType="html" label="FileScanRDD [44362]<br>parquet at PersistJob.java:35"]; 44363 [labelType="html" label="MapPartitionsRDD [44363]<br>parquet at PersistJob.java:35"]; } subgraph cluster103517 { label="WholeStageCodegen (38)"; 44364 [labelType="html" label="MapPartitionsRDD [44364]<br>parquet at PersistJob.java:35"]; } subgraph cluster103506 { label="CartesianProduct"; 44365 [labelType="html" label="UnsafeCartesianRDD [44365] [Unordered]<br>parquet at PersistJob.java:35"]; 44366 [labelType="html" label="MapPartitionsRDD [44366] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103502 { label="WholeStageCodegen (39)"; 44367 [labelType="html" label="MapPartitionsRDD [44367] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103501 { label="ObjectHashAggregate"; 44368 [labelType="html" label="MapPartitionsRDD [44368] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103500 { label="Exchange"; 44369 [labelType="html" label="MapPartitionsRDD [44369] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44355->44356; 44356->44357; 44358->44359; 44357->44360; 44359->44360; 44360->44361; 44362->44363; 44363->44364; 44361->44365; 44364->44365; 44365->44366; 44366->44367; 44367->44368; 44368->44369; }
44245,44358
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time