3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15825 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
74 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.2 KiB / 532
Associated Job Ids:
8002
DAG Visualization
digraph G { subgraph clusterstage_15825 { label="Stage 15825"; subgraph cluster103392 { label="Scan parquet "; 44280 [labelType="html" label="FileScanRDD [44280]<br>parquet at PersistJob.java:35"]; 44281 [labelType="html" label="MapPartitionsRDD [44281]<br>parquet at PersistJob.java:35"]; } subgraph cluster103387 { label="WholeStageCodegen (17)"; 44282 [labelType="html" label="MapPartitionsRDD [44282]<br>parquet at PersistJob.java:35"]; } subgraph cluster103398 { label="Scan parquet "; 44283 [labelType="html" label="FileScanRDD [44283]<br>parquet at PersistJob.java:35"]; 44284 [labelType="html" label="MapPartitionsRDD [44284]<br>parquet at PersistJob.java:35"]; } subgraph cluster103393 { label="WholeStageCodegen (18)"; 44285 [labelType="html" label="MapPartitionsRDD [44285]<br>parquet at PersistJob.java:35"]; } subgraph cluster103404 { label="Scan parquet "; 44286 [labelType="html" label="FileScanRDD [44286]<br>parquet at PersistJob.java:35"]; 44287 [labelType="html" label="MapPartitionsRDD [44287]<br>parquet at PersistJob.java:35"]; } subgraph cluster103399 { label="WholeStageCodegen (19)"; 44288 [labelType="html" label="MapPartitionsRDD [44288]<br>parquet at PersistJob.java:35"]; } subgraph cluster103386 { label="Union"; 44289 [labelType="html" label="UnionRDD [44289]<br>parquet at PersistJob.java:35"]; } subgraph cluster103385 { label="Exchange"; 44290 [labelType="html" label="MapPartitionsRDD [44290]<br>parquet at PersistJob.java:35"]; } } 44280->44281; 44281->44282; 44283->44284; 44284->44285; 44286->44287; 44287->44288; 44282->44289; 44285->44289; 44288->44289; 44289->44290; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time