3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13651 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.9 MiB / 2231133
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
399.0 B / 2
Associated Job Ids:
6829
DAG Visualization
digraph G { subgraph clusterstage_13651 { label="Stage 13651"; subgraph cluster88786 { label="Scan parquet "; 37834 [labelType="html" label="FileScanRDD [37834]<br>parquet at PersistJob.java:35"]; 37835 [labelType="html" label="MapPartitionsRDD [37835]<br>parquet at PersistJob.java:35"]; } subgraph cluster88781 { label="WholeStageCodegen (25)"; 37836 [labelType="html" label="MapPartitionsRDD [37836]<br>parquet at PersistJob.java:35"]; } subgraph cluster88789 { label="Exchange"; 37837 [labelType="html" label="ShuffledRowRDD [37837] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88787 { label="ObjectHashAggregate"; 37838 [labelType="html" label="MapPartitionsRDD [37838] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88780 { label="CartesianProduct"; 37839 [labelType="html" label="UnsafeCartesianRDD [37839] [Unordered]<br>parquet at PersistJob.java:35"]; 37840 [labelType="html" label="MapPartitionsRDD [37840] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88794 { label="Scan csv "; 37841 [labelType="html" label="FileScanRDD [37841]<br>parquet at PersistJob.java:35"]; 37842 [labelType="html" label="MapPartitionsRDD [37842]<br>parquet at PersistJob.java:35"]; } subgraph cluster88790 { label="WholeStageCodegen (26)"; 37843 [labelType="html" label="MapPartitionsRDD [37843]<br>parquet at PersistJob.java:35"]; } subgraph cluster88779 { label="CartesianProduct"; 37844 [labelType="html" label="UnsafeCartesianRDD [37844] [Unordered]<br>parquet at PersistJob.java:35"]; 37845 [labelType="html" label="MapPartitionsRDD [37845] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88775 { label="WholeStageCodegen (27)"; 37846 [labelType="html" label="MapPartitionsRDD [37846] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88774 { label="ObjectHashAggregate"; 37847 [labelType="html" label="MapPartitionsRDD [37847] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88773 { label="Exchange"; 37848 [labelType="html" label="MapPartitionsRDD [37848] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37834->37835; 37835->37836; 37837->37838; 37836->37839; 37838->37839; 37839->37840; 37841->37842; 37842->37843; 37840->37844; 37843->37844; 37844->37845; 37845->37846; 37846->37847; 37847->37848; }
37753,37837
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time