3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9292 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.2 MiB / 133183
Shuffle Read Size / Records:
2.6 KiB / 10
Associated Job Ids:
4751
DAG Visualization
digraph G { subgraph clusterstage_9292 { label="Stage 9292"; subgraph cluster61257 { label="Scan parquet "; 26895 [labelType="html" label="FileScanRDD [26895]<br>parquet at PersistJob.java:35"]; 26896 [labelType="html" label="MapPartitionsRDD [26896]<br>parquet at PersistJob.java:35"]; } subgraph cluster61252 { label="WholeStageCodegen (43)"; 26897 [labelType="html" label="MapPartitionsRDD [26897]<br>parquet at PersistJob.java:35"]; } subgraph cluster61260 { label="Exchange"; 26898 [labelType="html" label="ShuffledRowRDD [26898] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61258 { label="ObjectHashAggregate"; 26899 [labelType="html" label="MapPartitionsRDD [26899] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61251 { label="CartesianProduct"; 26900 [labelType="html" label="UnsafeCartesianRDD [26900] [Unordered]<br>parquet at PersistJob.java:35"]; 26901 [labelType="html" label="MapPartitionsRDD [26901] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61265 { label="Scan csv "; 26902 [labelType="html" label="FileScanRDD [26902]<br>parquet at PersistJob.java:35"]; 26903 [labelType="html" label="MapPartitionsRDD [26903]<br>parquet at PersistJob.java:35"]; } subgraph cluster61261 { label="WholeStageCodegen (44)"; 26904 [labelType="html" label="MapPartitionsRDD [26904]<br>parquet at PersistJob.java:35"]; } subgraph cluster61250 { label="CartesianProduct"; 26905 [labelType="html" label="UnsafeCartesianRDD [26905] [Unordered]<br>parquet at PersistJob.java:35"]; 26906 [labelType="html" label="MapPartitionsRDD [26906] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61246 { label="WholeStageCodegen (45)"; 26907 [labelType="html" label="MapPartitionsRDD [26907] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61245 { label="ObjectHashAggregate"; 26908 [labelType="html" label="MapPartitionsRDD [26908] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61244 { label="Exchange"; 26909 [labelType="html" label="MapPartitionsRDD [26909] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26895->26896; 26896->26897; 26898->26899; 26897->26900; 26899->26900; 26900->26901; 26902->26903; 26903->26904; 26901->26905; 26904->26905; 26905->26906; 26906->26907; 26907->26908; 26908->26909; }
26770,26898
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time