3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16994 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
39 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.5 KiB / 499
Associated Job Ids:
8279
DAG Visualization
digraph G { subgraph clusterstage_16994 { label="Stage 16994"; subgraph cluster108932 { label="Scan parquet "; 46585 [labelType="html" label="FileScanRDD [46585]<br>parquet at PersistJob.java:35"]; 46586 [labelType="html" label="MapPartitionsRDD [46586]<br>parquet at PersistJob.java:35"]; } subgraph cluster108927 { label="WholeStageCodegen (13)"; 46587 [labelType="html" label="MapPartitionsRDD [46587]<br>parquet at PersistJob.java:35"]; } subgraph cluster108938 { label="Scan parquet "; 46588 [labelType="html" label="FileScanRDD [46588]<br>parquet at PersistJob.java:35"]; 46589 [labelType="html" label="MapPartitionsRDD [46589]<br>parquet at PersistJob.java:35"]; } subgraph cluster108933 { label="WholeStageCodegen (14)"; 46590 [labelType="html" label="MapPartitionsRDD [46590]<br>parquet at PersistJob.java:35"]; } subgraph cluster108944 { label="Scan parquet "; 46591 [labelType="html" label="FileScanRDD [46591]<br>parquet at PersistJob.java:35"]; 46592 [labelType="html" label="MapPartitionsRDD [46592]<br>parquet at PersistJob.java:35"]; } subgraph cluster108939 { label="WholeStageCodegen (15)"; 46593 [labelType="html" label="MapPartitionsRDD [46593]<br>parquet at PersistJob.java:35"]; } subgraph cluster108926 { label="Union"; 46594 [labelType="html" label="UnionRDD [46594]<br>parquet at PersistJob.java:35"]; } subgraph cluster108925 { label="Exchange"; 46595 [labelType="html" label="MapPartitionsRDD [46595]<br>parquet at PersistJob.java:35"]; } } 46585->46586; 46586->46587; 46588->46589; 46589->46590; 46591->46592; 46592->46593; 46587->46594; 46590->46594; 46593->46594; 46594->46595; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time