3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7751 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Process local: 12
Input Size / Records:
10.6 MiB / 1115968
Shuffle Write Size / Records:
8.7 MiB / 427306
Associated Job Ids:
3773
DAG Visualization
digraph G { subgraph clusterstage_7751 { label="Stage 7751"; subgraph cluster50080 { label="Scan parquet "; 22142 [labelType="html" label="FileScanRDD [22142]<br>parquet at PersistJob.java:35"]; 22143 [labelType="html" label="MapPartitionsRDD [22143]<br>parquet at PersistJob.java:35"]; } subgraph cluster50075 { label="WholeStageCodegen (1)"; 22144 [labelType="html" label="MapPartitionsRDD [22144]<br>parquet at PersistJob.java:35"]; } subgraph cluster50085 { label="Scan csv "; 22145 [labelType="html" label="FileScanRDD [22145]<br>parquet at PersistJob.java:35"]; 22146 [labelType="html" label="MapPartitionsRDD [22146]<br>parquet at PersistJob.java:35"]; } subgraph cluster50081 { label="WholeStageCodegen (2)"; 22147 [labelType="html" label="MapPartitionsRDD [22147]<br>parquet at PersistJob.java:35"]; } subgraph cluster50074 { label="CartesianProduct"; 22148 [labelType="html" label="UnsafeCartesianRDD [22148]<br>parquet at PersistJob.java:35"]; 22149 [labelType="html" label="MapPartitionsRDD [22149]<br>parquet at PersistJob.java:35"]; } subgraph cluster50071 { label="WholeStageCodegen (3)"; 22150 [labelType="html" label="MapPartitionsRDD [22150]<br>parquet at PersistJob.java:35"]; } subgraph cluster50070 { label="ObjectHashAggregate"; 22151 [labelType="html" label="MapPartitionsRDD [22151]<br>parquet at PersistJob.java:35"]; } subgraph cluster50069 { label="Exchange"; 22152 [labelType="html" label="MapPartitionsRDD [22152]<br>parquet at PersistJob.java:35"]; } } 22142->22143; 22143->22144; 22145->22146; 22146->22147; 22144->22148; 22147->22148; 22148->22149; 22149->22150; 22150->22151; 22151->22152; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time