3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16136 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Read Size / Records:
740.0 B / 5
Associated Job Ids:
8139
DAG Visualization
digraph G { subgraph clusterstage_16136 { label="Stage 16136"; subgraph cluster105569 { label="Scan parquet "; 45384 [labelType="html" label="FileScanRDD [45384]<br>parquet at PersistJob.java:35"]; 45385 [labelType="html" label="MapPartitionsRDD [45385]<br>parquet at PersistJob.java:35"]; } subgraph cluster105564 { label="WholeStageCodegen (40)"; 45386 [labelType="html" label="MapPartitionsRDD [45386]<br>parquet at PersistJob.java:35"]; } subgraph cluster105572 { label="Exchange"; 45387 [labelType="html" label="ShuffledRowRDD [45387] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105570 { label="ObjectHashAggregate"; 45388 [labelType="html" label="MapPartitionsRDD [45388] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105563 { label="CartesianProduct"; 45389 [labelType="html" label="UnsafeCartesianRDD [45389] [Unordered]<br>parquet at PersistJob.java:35"]; 45390 [labelType="html" label="MapPartitionsRDD [45390] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105577 { label="Scan csv "; 45391 [labelType="html" label="FileScanRDD [45391]<br>parquet at PersistJob.java:35"]; 45392 [labelType="html" label="MapPartitionsRDD [45392]<br>parquet at PersistJob.java:35"]; } subgraph cluster105573 { label="WholeStageCodegen (41)"; 45393 [labelType="html" label="MapPartitionsRDD [45393]<br>parquet at PersistJob.java:35"]; } subgraph cluster105562 { label="CartesianProduct"; 45394 [labelType="html" label="UnsafeCartesianRDD [45394] [Unordered]<br>parquet at PersistJob.java:35"]; 45395 [labelType="html" label="MapPartitionsRDD [45395] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105558 { label="WholeStageCodegen (42)"; 45396 [labelType="html" label="MapPartitionsRDD [45396] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105557 { label="ObjectHashAggregate"; 45397 [labelType="html" label="MapPartitionsRDD [45397] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105556 { label="Exchange"; 45398 [labelType="html" label="MapPartitionsRDD [45398] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45384->45385; 45385->45386; 45387->45388; 45386->45389; 45388->45389; 45389->45390; 45391->45392; 45392->45393; 45390->45394; 45393->45394; 45394->45395; 45395->45396; 45396->45397; 45397->45398; }
45264,45387
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time