3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16249 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
10 s
Locality Level Summary:
Process local: 10
Input Size / Records:
9.9 MiB / 167755
Shuffle Write Size / Records:
14.1 MiB / 167745
Associated Job Ids:
7937
DAG Visualization
digraph G { subgraph clusterstage_16249 { label="Stage 16249"; subgraph cluster104231 { label="Scan parquet "; 44509 [labelType="html" label="FileScanRDD [44509]<br>parquet at PersistJob.java:35"]; 44510 [labelType="html" label="MapPartitionsRDD [44510]<br>parquet at PersistJob.java:35"]; } subgraph cluster104227 { label="WholeStageCodegen (1)"; 44511 [labelType="html" label="MapPartitionsRDD [44511]<br>parquet at PersistJob.java:35"]; } subgraph cluster104236 { label="Scan csv "; 44512 [labelType="html" label="FileScanRDD [44512]<br>parquet at PersistJob.java:35"]; 44513 [labelType="html" label="MapPartitionsRDD [44513]<br>parquet at PersistJob.java:35"]; } subgraph cluster104232 { label="WholeStageCodegen (2)"; 44514 [labelType="html" label="MapPartitionsRDD [44514]<br>parquet at PersistJob.java:35"]; } subgraph cluster104226 { label="CartesianProduct"; 44515 [labelType="html" label="UnsafeCartesianRDD [44515]<br>parquet at PersistJob.java:35"]; 44516 [labelType="html" label="MapPartitionsRDD [44516]<br>parquet at PersistJob.java:35"]; } subgraph cluster104222 { label="WholeStageCodegen (3)"; 44517 [labelType="html" label="MapPartitionsRDD [44517]<br>parquet at PersistJob.java:35"]; } subgraph cluster104221 { label="Exchange"; 44518 [labelType="html" label="MapPartitionsRDD [44518]<br>parquet at PersistJob.java:35"]; } } 44509->44510; 44510->44511; 44512->44513; 44513->44514; 44511->44515; 44514->44515; 44515->44516; 44516->44517; 44517->44518; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time