3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13648 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
78 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.2 KiB / 532
Associated Job Ids:
6827
DAG Visualization
digraph G { subgraph clusterstage_13648 { label="Stage 13648"; subgraph cluster88753 { label="Scan parquet "; 37819 [labelType="html" label="FileScanRDD [37819]<br>parquet at PersistJob.java:35"]; 37820 [labelType="html" label="MapPartitionsRDD [37820]<br>parquet at PersistJob.java:35"]; } subgraph cluster88748 { label="WholeStageCodegen (17)"; 37821 [labelType="html" label="MapPartitionsRDD [37821]<br>parquet at PersistJob.java:35"]; } subgraph cluster88759 { label="Scan parquet "; 37822 [labelType="html" label="FileScanRDD [37822]<br>parquet at PersistJob.java:35"]; 37823 [labelType="html" label="MapPartitionsRDD [37823]<br>parquet at PersistJob.java:35"]; } subgraph cluster88754 { label="WholeStageCodegen (18)"; 37824 [labelType="html" label="MapPartitionsRDD [37824]<br>parquet at PersistJob.java:35"]; } subgraph cluster88765 { label="Scan parquet "; 37825 [labelType="html" label="FileScanRDD [37825]<br>parquet at PersistJob.java:35"]; 37826 [labelType="html" label="MapPartitionsRDD [37826]<br>parquet at PersistJob.java:35"]; } subgraph cluster88760 { label="WholeStageCodegen (19)"; 37827 [labelType="html" label="MapPartitionsRDD [37827]<br>parquet at PersistJob.java:35"]; } subgraph cluster88747 { label="Union"; 37828 [labelType="html" label="UnionRDD [37828]<br>parquet at PersistJob.java:35"]; } subgraph cluster88746 { label="Exchange"; 37829 [labelType="html" label="MapPartitionsRDD [37829]<br>parquet at PersistJob.java:35"]; } } 37819->37820; 37820->37821; 37822->37823; 37823->37824; 37825->37826; 37826->37827; 37821->37828; 37824->37828; 37827->37828; 37828->37829; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time