3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15345 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
10.0 MiB / 169558
Shuffle Write Size / Records:
14.2 MiB / 169548
Associated Job Ids:
8070
DAG Visualization
digraph G { subgraph clusterstage_15345 { label="Stage 15345"; subgraph cluster99239 { label="Scan parquet "; 41898 [labelType="html" label="FileScanRDD [41898]<br>parquet at PersistJob.java:35"]; 41899 [labelType="html" label="MapPartitionsRDD [41899]<br>parquet at PersistJob.java:35"]; } subgraph cluster99235 { label="WholeStageCodegen (1)"; 41900 [labelType="html" label="MapPartitionsRDD [41900]<br>parquet at PersistJob.java:35"]; } subgraph cluster99244 { label="Scan csv "; 41901 [labelType="html" label="FileScanRDD [41901]<br>parquet at PersistJob.java:35"]; 41902 [labelType="html" label="MapPartitionsRDD [41902]<br>parquet at PersistJob.java:35"]; } subgraph cluster99240 { label="WholeStageCodegen (2)"; 41903 [labelType="html" label="MapPartitionsRDD [41903]<br>parquet at PersistJob.java:35"]; } subgraph cluster99234 { label="CartesianProduct"; 41904 [labelType="html" label="UnsafeCartesianRDD [41904]<br>parquet at PersistJob.java:35"]; 41905 [labelType="html" label="MapPartitionsRDD [41905]<br>parquet at PersistJob.java:35"]; } subgraph cluster99230 { label="WholeStageCodegen (3)"; 41906 [labelType="html" label="MapPartitionsRDD [41906]<br>parquet at PersistJob.java:35"]; } subgraph cluster99229 { label="Exchange"; 41907 [labelType="html" label="MapPartitionsRDD [41907]<br>parquet at PersistJob.java:35"]; } } 41898->41899; 41899->41900; 41901->41902; 41902->41903; 41900->41904; 41903->41904; 41904->41905; 41905->41906; 41906->41907; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time