3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32590 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
5.8 MiB / 591893
Shuffle Write Size / Records:
6.4 MiB / 591883
Associated Job Ids:
17954
DAG Visualization
digraph G { subgraph clusterstage_32590 { label="Stage 32590"; subgraph cluster207742 { label="Scan parquet "; 89930 [labelType="html" label="FileScanRDD [89930]<br>parquet at PersistJob.java:35"]; 89931 [labelType="html" label="MapPartitionsRDD [89931]<br>parquet at PersistJob.java:35"]; } subgraph cluster207737 { label="WholeStageCodegen (1)"; 89932 [labelType="html" label="MapPartitionsRDD [89932]<br>parquet at PersistJob.java:35"]; } subgraph cluster207747 { label="Scan csv "; 89933 [labelType="html" label="FileScanRDD [89933]<br>parquet at PersistJob.java:35"]; 89934 [labelType="html" label="MapPartitionsRDD [89934]<br>parquet at PersistJob.java:35"]; } subgraph cluster207743 { label="WholeStageCodegen (2)"; 89935 [labelType="html" label="MapPartitionsRDD [89935]<br>parquet at PersistJob.java:35"]; } subgraph cluster207736 { label="CartesianProduct"; 89936 [labelType="html" label="UnsafeCartesianRDD [89936]<br>parquet at PersistJob.java:35"]; 89937 [labelType="html" label="MapPartitionsRDD [89937]<br>parquet at PersistJob.java:35"]; } subgraph cluster207733 { label="WholeStageCodegen (3)"; 89938 [labelType="html" label="MapPartitionsRDD [89938]<br>parquet at PersistJob.java:35"]; } subgraph cluster207732 { label="Exchange"; 89939 [labelType="html" label="MapPartitionsRDD [89939]<br>parquet at PersistJob.java:35"]; } } 89930->89931; 89931->89932; 89933->89934; 89934->89935; 89932->89936; 89935->89936; 89936->89937; 89937->89938; 89938->89939; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time