3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15084 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Process local: 10
Input Size / Records:
3.6 MiB / 169558
Output Size / Records:
23.6 KiB / 12
Associated Job Ids:
7924
DAG Visualization
digraph G { subgraph clusterstage_15084 { label="Stage 15084"; subgraph cluster96874 { label="Scan parquet "; 40874 [labelType="html" label="FileScanRDD [40874]<br>parquet at PersistJob.java:35"]; 40875 [labelType="html" label="MapPartitionsRDD [40875]<br>parquet at PersistJob.java:35"]; } subgraph cluster96869 { label="WholeStageCodegen (1)"; 40876 [labelType="html" label="MapPartitionsRDD [40876]<br>parquet at PersistJob.java:35"]; } subgraph cluster96879 { label="Scan csv "; 40877 [labelType="html" label="FileScanRDD [40877]<br>parquet at PersistJob.java:35"]; 40878 [labelType="html" label="MapPartitionsRDD [40878]<br>parquet at PersistJob.java:35"]; } subgraph cluster96875 { label="WholeStageCodegen (2)"; 40879 [labelType="html" label="MapPartitionsRDD [40879]<br>parquet at PersistJob.java:35"]; } subgraph cluster96868 { label="CartesianProduct"; 40880 [labelType="html" label="UnsafeCartesianRDD [40880]<br>parquet at PersistJob.java:35"]; 40881 [labelType="html" label="MapPartitionsRDD [40881]<br>parquet at PersistJob.java:35"]; } subgraph cluster96864 { label="WholeStageCodegen (3)"; 40882 [labelType="html" label="MapPartitionsRDD [40882]<br>parquet at PersistJob.java:35"]; } subgraph cluster96863 { label="WriteFiles"; 40883 [labelType="html" label="MapPartitionsRDD [40883]<br>parquet at PersistJob.java:35"]; } } 40874->40875; 40875->40876; 40877->40878; 40878->40879; 40876->40880; 40879->40880; 40880->40881; 40881->40882; 40882->40883; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time