3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32574 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Process local: 10
Input Size / Records:
4.5 MiB / 591893
Shuffle Write Size / Records:
4.7 MiB / 591883
Associated Job Ids:
17944
DAG Visualization
digraph G { subgraph clusterstage_32574 { label="Stage 32574"; subgraph cluster207551 { label="Scan parquet "; 89848 [labelType="html" label="FileScanRDD [89848]<br>parquet at PersistJob.java:35"]; 89849 [labelType="html" label="MapPartitionsRDD [89849]<br>parquet at PersistJob.java:35"]; } subgraph cluster207547 { label="WholeStageCodegen (1)"; 89850 [labelType="html" label="MapPartitionsRDD [89850]<br>parquet at PersistJob.java:35"]; } subgraph cluster207560 { label="Scan csv "; 89851 [labelType="html" label="FileScanRDD [89851]<br>parquet at PersistJob.java:35"]; 89852 [labelType="html" label="MapPartitionsRDD [89852]<br>parquet at PersistJob.java:35"]; } subgraph cluster207556 { label="WholeStageCodegen (2)"; 89854 [labelType="html" label="MapPartitionsRDD [89854]<br>parquet at PersistJob.java:35"]; } subgraph cluster207546 { label="CartesianProduct"; 89855 [labelType="html" label="UnsafeCartesianRDD [89855]<br>parquet at PersistJob.java:35"]; 89856 [labelType="html" label="MapPartitionsRDD [89856]<br>parquet at PersistJob.java:35"]; } subgraph cluster207545 { label="Exchange"; 89857 [labelType="html" label="MapPartitionsRDD [89857]<br>parquet at PersistJob.java:35"]; } } 89848->89849; 89849->89850; 89851->89852; 89852->89854; 89850->89855; 89854->89855; 89855->89856; 89856->89857; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time