3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13661 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
14.5 MiB / 2231133
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
6834
DAG Visualization
digraph G { subgraph clusterstage_13661 { label="Stage 13661"; subgraph cluster88896 { label="Scan parquet "; 37909 [labelType="html" label="FileScanRDD [37909]<br>parquet at PersistJob.java:35"]; 37910 [labelType="html" label="MapPartitionsRDD [37910]<br>parquet at PersistJob.java:35"]; } subgraph cluster88891 { label="WholeStageCodegen (40)"; 37911 [labelType="html" label="MapPartitionsRDD [37911]<br>parquet at PersistJob.java:35"]; } subgraph cluster88899 { label="Exchange"; 37912 [labelType="html" label="ShuffledRowRDD [37912] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88897 { label="ObjectHashAggregate"; 37913 [labelType="html" label="MapPartitionsRDD [37913] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88890 { label="CartesianProduct"; 37914 [labelType="html" label="UnsafeCartesianRDD [37914] [Unordered]<br>parquet at PersistJob.java:35"]; 37915 [labelType="html" label="MapPartitionsRDD [37915] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88904 { label="Scan csv "; 37916 [labelType="html" label="FileScanRDD [37916]<br>parquet at PersistJob.java:35"]; 37917 [labelType="html" label="MapPartitionsRDD [37917]<br>parquet at PersistJob.java:35"]; } subgraph cluster88900 { label="WholeStageCodegen (41)"; 37918 [labelType="html" label="MapPartitionsRDD [37918]<br>parquet at PersistJob.java:35"]; } subgraph cluster88889 { label="CartesianProduct"; 37919 [labelType="html" label="UnsafeCartesianRDD [37919] [Unordered]<br>parquet at PersistJob.java:35"]; 37920 [labelType="html" label="MapPartitionsRDD [37920] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88885 { label="WholeStageCodegen (42)"; 37921 [labelType="html" label="MapPartitionsRDD [37921] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88884 { label="ObjectHashAggregate"; 37922 [labelType="html" label="MapPartitionsRDD [37922] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88883 { label="Exchange"; 37923 [labelType="html" label="MapPartitionsRDD [37923] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37909->37910; 37910->37911; 37912->37913; 37911->37914; 37913->37914; 37914->37915; 37916->37917; 37917->37918; 37915->37919; 37918->37919; 37919->37920; 37920->37921; 37921->37922; 37922->37923; }
37789,37912
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time