3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16128 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.0 s
Locality Level Summary:
Any: 5
Input Size / Records:
1808.4 KiB / 74864
Shuffle Read Size / Records:
1010.0 B / 5
Shuffle Write Size / Records:
3.9 KiB / 83
Associated Job Ids:
8135
DAG Visualization
digraph G { subgraph clusterstage_16128 { label="Stage 16128"; subgraph cluster105481 { label="Scan parquet "; 45324 [labelType="html" label="FileScanRDD [45324]<br>parquet at PersistJob.java:35"]; 45325 [labelType="html" label="MapPartitionsRDD [45325]<br>parquet at PersistJob.java:35"]; } subgraph cluster105476 { label="WholeStageCodegen (28)"; 45326 [labelType="html" label="MapPartitionsRDD [45326]<br>parquet at PersistJob.java:35"]; } subgraph cluster105484 { label="Exchange"; 45327 [labelType="html" label="ShuffledRowRDD [45327] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105482 { label="ObjectHashAggregate"; 45328 [labelType="html" label="MapPartitionsRDD [45328] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105475 { label="CartesianProduct"; 45329 [labelType="html" label="UnsafeCartesianRDD [45329] [Unordered]<br>parquet at PersistJob.java:35"]; 45330 [labelType="html" label="MapPartitionsRDD [45330] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105489 { label="Scan csv "; 45331 [labelType="html" label="FileScanRDD [45331]<br>parquet at PersistJob.java:35"]; 45332 [labelType="html" label="MapPartitionsRDD [45332]<br>parquet at PersistJob.java:35"]; } subgraph cluster105485 { label="WholeStageCodegen (29)"; 45333 [labelType="html" label="MapPartitionsRDD [45333]<br>parquet at PersistJob.java:35"]; } subgraph cluster105474 { label="CartesianProduct"; 45334 [labelType="html" label="UnsafeCartesianRDD [45334] [Unordered]<br>parquet at PersistJob.java:35"]; 45335 [labelType="html" label="MapPartitionsRDD [45335] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105470 { label="WholeStageCodegen (30)"; 45336 [labelType="html" label="MapPartitionsRDD [45336] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105469 { label="ObjectHashAggregate"; 45337 [labelType="html" label="MapPartitionsRDD [45337] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105468 { label="Exchange"; 45338 [labelType="html" label="MapPartitionsRDD [45338] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45324->45325; 45325->45326; 45327->45328; 45326->45329; 45328->45329; 45329->45330; 45331->45332; 45332->45333; 45330->45334; 45333->45334; 45334->45335; 45335->45336; 45336->45337; 45337->45338; }
45244,45327
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time