3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13663 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231133
Shuffle Read Size / Records:
2.6 KiB / 10
Shuffle Write Size / Records:
2.5 KiB / 31
Associated Job Ids:
6835
DAG Visualization
digraph G { subgraph clusterstage_13663 { label="Stage 13663"; subgraph cluster88918 { label="Scan parquet "; 37924 [labelType="html" label="FileScanRDD [37924]<br>parquet at PersistJob.java:35"]; 37925 [labelType="html" label="MapPartitionsRDD [37925]<br>parquet at PersistJob.java:35"]; } subgraph cluster88913 { label="WholeStageCodegen (43)"; 37926 [labelType="html" label="MapPartitionsRDD [37926]<br>parquet at PersistJob.java:35"]; } subgraph cluster88921 { label="Exchange"; 37927 [labelType="html" label="ShuffledRowRDD [37927] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88919 { label="ObjectHashAggregate"; 37928 [labelType="html" label="MapPartitionsRDD [37928] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88912 { label="CartesianProduct"; 37929 [labelType="html" label="UnsafeCartesianRDD [37929] [Unordered]<br>parquet at PersistJob.java:35"]; 37930 [labelType="html" label="MapPartitionsRDD [37930] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88926 { label="Scan csv "; 37931 [labelType="html" label="FileScanRDD [37931]<br>parquet at PersistJob.java:35"]; 37932 [labelType="html" label="MapPartitionsRDD [37932]<br>parquet at PersistJob.java:35"]; } subgraph cluster88922 { label="WholeStageCodegen (44)"; 37933 [labelType="html" label="MapPartitionsRDD [37933]<br>parquet at PersistJob.java:35"]; } subgraph cluster88911 { label="CartesianProduct"; 37934 [labelType="html" label="UnsafeCartesianRDD [37934] [Unordered]<br>parquet at PersistJob.java:35"]; 37935 [labelType="html" label="MapPartitionsRDD [37935] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88907 { label="WholeStageCodegen (45)"; 37936 [labelType="html" label="MapPartitionsRDD [37936] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88906 { label="ObjectHashAggregate"; 37937 [labelType="html" label="MapPartitionsRDD [37937] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88905 { label="Exchange"; 37938 [labelType="html" label="MapPartitionsRDD [37938] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37924->37925; 37925->37926; 37927->37928; 37926->37929; 37928->37929; 37929->37930; 37931->37932; 37932->37933; 37930->37934; 37933->37934; 37934->37935; 37935->37936; 37936->37937; 37937->37938; }
37799,37927
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time