3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13665 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Any: 10
Input Size / Records:
92.4 MiB / 2231133
Shuffle Read Size / Records:
460.0 B / 10
Shuffle Write Size / Records:
8.5 MiB / 256548
Associated Job Ids:
6836
DAG Visualization
digraph G { subgraph clusterstage_13665 { label="Stage 13665"; subgraph cluster88941 { label="Scan parquet "; 37939 [labelType="html" label="FileScanRDD [37939]<br>parquet at PersistJob.java:35"]; 37940 [labelType="html" label="MapPartitionsRDD [37940]<br>parquet at PersistJob.java:35"]; } subgraph cluster88936 { label="WholeStageCodegen (46)"; 37941 [labelType="html" label="MapPartitionsRDD [37941]<br>parquet at PersistJob.java:35"]; } subgraph cluster88946 { label="Scan csv "; 37942 [labelType="html" label="FileScanRDD [37942]<br>parquet at PersistJob.java:35"]; 37943 [labelType="html" label="MapPartitionsRDD [37943]<br>parquet at PersistJob.java:35"]; } subgraph cluster88942 { label="WholeStageCodegen (47)"; 37944 [labelType="html" label="MapPartitionsRDD [37944]<br>parquet at PersistJob.java:35"]; } subgraph cluster88935 { label="CartesianProduct"; 37945 [labelType="html" label="UnsafeCartesianRDD [37945]<br>parquet at PersistJob.java:35"]; 37946 [labelType="html" label="MapPartitionsRDD [37946]<br>parquet at PersistJob.java:35"]; } subgraph cluster88932 { label="WholeStageCodegen (48)"; 37947 [labelType="html" label="MapPartitionsRDD [37947]<br>parquet at PersistJob.java:35"]; } subgraph cluster88951 { label="Exchange"; 37948 [labelType="html" label="ShuffledRowRDD [37948] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88947 { label="WholeStageCodegen (49)"; 37949 [labelType="html" label="MapPartitionsRDD [37949] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88931 { label="CartesianProduct"; 37950 [labelType="html" label="UnsafeCartesianRDD [37950] [Unordered]<br>parquet at PersistJob.java:35"]; 37951 [labelType="html" label="MapPartitionsRDD [37951] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88928 { label="WholeStageCodegen (50)"; 37952 [labelType="html" label="MapPartitionsRDD [37952] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster88927 { label="Exchange"; 37953 [labelType="html" label="MapPartitionsRDD [37953] [Unordered]<br>parquet at PersistJob.java:35"]; } } 37939->37940; 37940->37941; 37942->37943; 37943->37944; 37941->37945; 37944->37945; 37945->37946; 37946->37947; 37948->37949; 37947->37950; 37949->37950; 37950->37951; 37951->37952; 37952->37953; }
37814,37948
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time