3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13653 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
16.3 MiB / 2231133
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
3.9 KiB / 78
Associated Job Ids:
6830
DAG Visualization
digraph G { subgraph clusterstage_13653 { label="Stage 13653"; subgraph cluster88808 { label="Scan parquet "; 37849 [labelType="html" label="FileScanRDD [37849]<br>parquet at PersistJob.java:35"]; 37850 [labelType="html" label="MapPartitionsRDD [37850]<br>parquet at PersistJob.java:35"]; } subgraph cluster88803 { label="WholeStageCodegen (28)"; 37851 [labelType="html" label="MapPartitionsRDD [37851]<br>parquet at PersistJob.java:35"]; } subgraph cluster88811 { label="Exchange"; 37852 [labelType="html" label="ShuffledRowRDD [37852] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88809 { label="ObjectHashAggregate"; 37853 [labelType="html" label="MapPartitionsRDD [37853] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88802 { label="CartesianProduct"; 37854 [labelType="html" label="UnsafeCartesianRDD [37854] [Unordered]<br>parquet at PersistJob.java:35"]; 37855 [labelType="html" label="MapPartitionsRDD [37855] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88816 { label="Scan csv "; 37856 [labelType="html" label="FileScanRDD [37856]<br>parquet at PersistJob.java:35"]; 37857 [labelType="html" label="MapPartitionsRDD [37857]<br>parquet at PersistJob.java:35"]; } subgraph cluster88812 { label="WholeStageCodegen (29)"; 37858 [labelType="html" label="MapPartitionsRDD [37858]<br>parquet at PersistJob.java:35"]; } subgraph cluster88801 { label="CartesianProduct"; 37859 [labelType="html" label="UnsafeCartesianRDD [37859] [Unordered]<br>parquet at PersistJob.java:35"]; 37860 [labelType="html" label="MapPartitionsRDD [37860] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88797 { label="WholeStageCodegen (30)"; 37861 [labelType="html" label="MapPartitionsRDD [37861] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88796 { label="ObjectHashAggregate"; 37862 [labelType="html" label="MapPartitionsRDD [37862] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88795 { label="Exchange"; 37863 [labelType="html" label="MapPartitionsRDD [37863] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37849->37850; 37850->37851; 37852->37853; 37851->37854; 37853->37854; 37854->37855; 37856->37857; 37857->37858; 37855->37859; 37858->37859; 37859->37860; 37860->37861; 37861->37862; 37862->37863; }
37769,37852
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time