3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16957 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
3.3 MiB / 48286
Shuffle Write Size / Records:
3.5 MiB / 48276
Associated Job Ids:
8252
DAG Visualization
digraph G { subgraph clusterstage_16957 { label="Stage 16957"; subgraph cluster108468 { label="Scan parquet "; 46378 [labelType="html" label="FileScanRDD [46378]<br>parquet at PersistJob.java:35"]; 46379 [labelType="html" label="MapPartitionsRDD [46379]<br>parquet at PersistJob.java:35"]; } subgraph cluster108463 { label="WholeStageCodegen (1)"; 46380 [labelType="html" label="MapPartitionsRDD [46380]<br>parquet at PersistJob.java:35"]; } subgraph cluster108473 { label="Scan csv "; 46381 [labelType="html" label="FileScanRDD [46381]<br>parquet at PersistJob.java:35"]; 46382 [labelType="html" label="MapPartitionsRDD [46382]<br>parquet at PersistJob.java:35"]; } subgraph cluster108469 { label="WholeStageCodegen (2)"; 46383 [labelType="html" label="MapPartitionsRDD [46383]<br>parquet at PersistJob.java:35"]; } subgraph cluster108462 { label="CartesianProduct"; 46384 [labelType="html" label="UnsafeCartesianRDD [46384]<br>parquet at PersistJob.java:35"]; 46385 [labelType="html" label="MapPartitionsRDD [46385]<br>parquet at PersistJob.java:35"]; } subgraph cluster108454 { label="WholeStageCodegen (3)"; 46386 [labelType="html" label="MapPartitionsRDD [46386]<br>parquet at PersistJob.java:35"]; } subgraph cluster108453 { label="Exchange"; 46387 [labelType="html" label="MapPartitionsRDD [46387]<br>parquet at PersistJob.java:35"]; } } 46378->46379; 46379->46380; 46381->46382; 46382->46383; 46380->46384; 46383->46384; 46384->46385; 46385->46386; 46386->46387; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time