3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16132 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Read Size / Records:
1725.0 B / 5
Associated Job Ids:
8137
DAG Visualization
digraph G { subgraph clusterstage_16132 { label="Stage 16132"; subgraph cluster105525 { label="Scan parquet "; 45354 [labelType="html" label="FileScanRDD [45354]<br>parquet at PersistJob.java:35"]; 45355 [labelType="html" label="MapPartitionsRDD [45355]<br>parquet at PersistJob.java:35"]; } subgraph cluster105520 { label="WholeStageCodegen (34)"; 45356 [labelType="html" label="MapPartitionsRDD [45356]<br>parquet at PersistJob.java:35"]; } subgraph cluster105528 { label="Exchange"; 45357 [labelType="html" label="ShuffledRowRDD [45357] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105526 { label="ObjectHashAggregate"; 45358 [labelType="html" label="MapPartitionsRDD [45358] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105519 { label="CartesianProduct"; 45359 [labelType="html" label="UnsafeCartesianRDD [45359] [Unordered]<br>parquet at PersistJob.java:35"]; 45360 [labelType="html" label="MapPartitionsRDD [45360] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105533 { label="Scan csv "; 45361 [labelType="html" label="FileScanRDD [45361]<br>parquet at PersistJob.java:35"]; 45362 [labelType="html" label="MapPartitionsRDD [45362]<br>parquet at PersistJob.java:35"]; } subgraph cluster105529 { label="WholeStageCodegen (35)"; 45363 [labelType="html" label="MapPartitionsRDD [45363]<br>parquet at PersistJob.java:35"]; } subgraph cluster105518 { label="CartesianProduct"; 45364 [labelType="html" label="UnsafeCartesianRDD [45364] [Unordered]<br>parquet at PersistJob.java:35"]; 45365 [labelType="html" label="MapPartitionsRDD [45365] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105514 { label="WholeStageCodegen (36)"; 45366 [labelType="html" label="MapPartitionsRDD [45366] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105513 { label="ObjectHashAggregate"; 45367 [labelType="html" label="MapPartitionsRDD [45367] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105512 { label="Exchange"; 45368 [labelType="html" label="MapPartitionsRDD [45368] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45354->45355; 45355->45356; 45357->45358; 45356->45359; 45358->45359; 45359->45360; 45361->45362; 45362->45363; 45360->45364; 45363->45364; 45364->45365; 45365->45366; 45366->45367; 45367->45368; }
45254,45357
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time