3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 42909 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
45 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.3 KiB / 532
Associated Job Ids:
22517
DAG Visualization
digraph G { subgraph clusterstage_42909 { label="Stage 42909"; subgraph cluster294853 { label="Scan parquet "; 129258 [labelType="html" label="FileScanRDD [129258]<br>parquet at PersistJob.java:35"]; 129259 [labelType="html" label="MapPartitionsRDD [129259]<br>parquet at PersistJob.java:35"]; } subgraph cluster294848 { label="WholeStageCodegen (13)"; 129260 [labelType="html" label="MapPartitionsRDD [129260]<br>parquet at PersistJob.java:35"]; } subgraph cluster294859 { label="Scan parquet "; 129261 [labelType="html" label="FileScanRDD [129261]<br>parquet at PersistJob.java:35"]; 129262 [labelType="html" label="MapPartitionsRDD [129262]<br>parquet at PersistJob.java:35"]; } subgraph cluster294854 { label="WholeStageCodegen (14)"; 129263 [labelType="html" label="MapPartitionsRDD [129263]<br>parquet at PersistJob.java:35"]; } subgraph cluster294865 { label="Scan parquet "; 129264 [labelType="html" label="FileScanRDD [129264]<br>parquet at PersistJob.java:35"]; 129265 [labelType="html" label="MapPartitionsRDD [129265]<br>parquet at PersistJob.java:35"]; } subgraph cluster294860 { label="WholeStageCodegen (15)"; 129266 [labelType="html" label="MapPartitionsRDD [129266]<br>parquet at PersistJob.java:35"]; } subgraph cluster294847 { label="Union"; 129267 [labelType="html" label="UnionRDD [129267]<br>parquet at PersistJob.java:35"]; } subgraph cluster294846 { label="Exchange"; 129268 [labelType="html" label="MapPartitionsRDD [129268]<br>parquet at PersistJob.java:35"]; } } 129258->129259; 129259->129260; 129261->129262; 129262->129263; 129264->129265; 129265->129266; 129260->129267; 129263->129267; 129266->129267; 129267->129268; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time