3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13655 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.8 MiB / 2231133
Shuffle Read Size / Records:
1840.0 B / 10
Shuffle Write Size / Records:
26.9 KiB / 945
Associated Job Ids:
6831
DAG Visualization
digraph G { subgraph clusterstage_13655 { label="Stage 13655"; subgraph cluster88830 { label="Scan parquet "; 37864 [labelType="html" label="FileScanRDD [37864]<br>parquet at PersistJob.java:35"]; 37865 [labelType="html" label="MapPartitionsRDD [37865]<br>parquet at PersistJob.java:35"]; } subgraph cluster88825 { label="WholeStageCodegen (31)"; 37866 [labelType="html" label="MapPartitionsRDD [37866]<br>parquet at PersistJob.java:35"]; } subgraph cluster88833 { label="Exchange"; 37867 [labelType="html" label="ShuffledRowRDD [37867] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88831 { label="ObjectHashAggregate"; 37868 [labelType="html" label="MapPartitionsRDD [37868] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88824 { label="CartesianProduct"; 37869 [labelType="html" label="UnsafeCartesianRDD [37869] [Unordered]<br>parquet at PersistJob.java:35"]; 37870 [labelType="html" label="MapPartitionsRDD [37870] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88838 { label="Scan csv "; 37871 [labelType="html" label="FileScanRDD [37871]<br>parquet at PersistJob.java:35"]; 37872 [labelType="html" label="MapPartitionsRDD [37872]<br>parquet at PersistJob.java:35"]; } subgraph cluster88834 { label="WholeStageCodegen (32)"; 37873 [labelType="html" label="MapPartitionsRDD [37873]<br>parquet at PersistJob.java:35"]; } subgraph cluster88823 { label="CartesianProduct"; 37874 [labelType="html" label="UnsafeCartesianRDD [37874] [Unordered]<br>parquet at PersistJob.java:35"]; 37875 [labelType="html" label="MapPartitionsRDD [37875] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88819 { label="WholeStageCodegen (33)"; 37876 [labelType="html" label="MapPartitionsRDD [37876] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88818 { label="ObjectHashAggregate"; 37877 [labelType="html" label="MapPartitionsRDD [37877] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88817 { label="Exchange"; 37878 [labelType="html" label="MapPartitionsRDD [37878] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37864->37865; 37865->37866; 37867->37868; 37866->37869; 37868->37869; 37869->37870; 37871->37872; 37872->37873; 37870->37874; 37873->37874; 37874->37875; 37875->37876; 37876->37877; 37877->37878; }
37774,37867
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time