3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12865 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
43 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
6327
DAG Visualization
digraph G { subgraph clusterstage_12865 { label="Stage 12865"; subgraph cluster83495 { label="Scan parquet "; 35502 [labelType="html" label="FileScanRDD [35502]<br>parquet at PersistJob.java:35"]; 35503 [labelType="html" label="MapPartitionsRDD [35503]<br>parquet at PersistJob.java:35"]; } subgraph cluster83490 { label="WholeStageCodegen (13)"; 35504 [labelType="html" label="MapPartitionsRDD [35504]<br>parquet at PersistJob.java:35"]; } subgraph cluster83501 { label="Scan parquet "; 35505 [labelType="html" label="FileScanRDD [35505]<br>parquet at PersistJob.java:35"]; 35506 [labelType="html" label="MapPartitionsRDD [35506]<br>parquet at PersistJob.java:35"]; } subgraph cluster83496 { label="WholeStageCodegen (14)"; 35507 [labelType="html" label="MapPartitionsRDD [35507]<br>parquet at PersistJob.java:35"]; } subgraph cluster83507 { label="Scan parquet "; 35508 [labelType="html" label="FileScanRDD [35508]<br>parquet at PersistJob.java:35"]; 35509 [labelType="html" label="MapPartitionsRDD [35509]<br>parquet at PersistJob.java:35"]; } subgraph cluster83502 { label="WholeStageCodegen (15)"; 35510 [labelType="html" label="MapPartitionsRDD [35510]<br>parquet at PersistJob.java:35"]; } subgraph cluster83489 { label="Union"; 35511 [labelType="html" label="UnionRDD [35511]<br>parquet at PersistJob.java:35"]; } subgraph cluster83488 { label="Exchange"; 35512 [labelType="html" label="MapPartitionsRDD [35512]<br>parquet at PersistJob.java:35"]; } } 35502->35503; 35503->35504; 35505->35506; 35506->35507; 35508->35509; 35509->35510; 35504->35511; 35507->35511; 35510->35511; 35511->35512; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time