3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16130 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.0 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Read Size / Records:
920.0 B / 5
Shuffle Write Size / Records:
4.9 KiB / 120
Associated Job Ids:
8136
DAG Visualization
digraph G { subgraph clusterstage_16130 { label="Stage 16130"; subgraph cluster105503 { label="Scan parquet "; 45339 [labelType="html" label="FileScanRDD [45339]<br>parquet at PersistJob.java:35"]; 45340 [labelType="html" label="MapPartitionsRDD [45340]<br>parquet at PersistJob.java:35"]; } subgraph cluster105498 { label="WholeStageCodegen (31)"; 45341 [labelType="html" label="MapPartitionsRDD [45341]<br>parquet at PersistJob.java:35"]; } subgraph cluster105506 { label="Exchange"; 45342 [labelType="html" label="ShuffledRowRDD [45342] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105504 { label="ObjectHashAggregate"; 45343 [labelType="html" label="MapPartitionsRDD [45343] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105497 { label="CartesianProduct"; 45344 [labelType="html" label="UnsafeCartesianRDD [45344] [Unordered]<br>parquet at PersistJob.java:35"]; 45345 [labelType="html" label="MapPartitionsRDD [45345] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105511 { label="Scan csv "; 45346 [labelType="html" label="FileScanRDD [45346]<br>parquet at PersistJob.java:35"]; 45347 [labelType="html" label="MapPartitionsRDD [45347]<br>parquet at PersistJob.java:35"]; } subgraph cluster105507 { label="WholeStageCodegen (32)"; 45348 [labelType="html" label="MapPartitionsRDD [45348]<br>parquet at PersistJob.java:35"]; } subgraph cluster105496 { label="CartesianProduct"; 45349 [labelType="html" label="UnsafeCartesianRDD [45349] [Unordered]<br>parquet at PersistJob.java:35"]; 45350 [labelType="html" label="MapPartitionsRDD [45350] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105492 { label="WholeStageCodegen (33)"; 45351 [labelType="html" label="MapPartitionsRDD [45351] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105491 { label="ObjectHashAggregate"; 45352 [labelType="html" label="MapPartitionsRDD [45352] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105490 { label="Exchange"; 45353 [labelType="html" label="MapPartitionsRDD [45353] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45339->45340; 45340->45341; 45342->45343; 45341->45344; 45343->45344; 45344->45345; 45346->45347; 45347->45348; 45345->45349; 45348->45349; 45349->45350; 45350->45351; 45351->45352; 45352->45353; }
45249,45342
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time