3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9277 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.3 KiB / 532
Associated Job Ids:
4743
DAG Visualization
digraph G { subgraph clusterstage_9277 { label="Stage 9277"; subgraph cluster61092 { label="Scan parquet "; 26790 [labelType="html" label="FileScanRDD [26790]<br>parquet at PersistJob.java:35"]; 26791 [labelType="html" label="MapPartitionsRDD [26791]<br>parquet at PersistJob.java:35"]; } subgraph cluster61087 { label="WholeStageCodegen (17)"; 26792 [labelType="html" label="MapPartitionsRDD [26792]<br>parquet at PersistJob.java:35"]; } subgraph cluster61098 { label="Scan parquet "; 26793 [labelType="html" label="FileScanRDD [26793]<br>parquet at PersistJob.java:35"]; 26794 [labelType="html" label="MapPartitionsRDD [26794]<br>parquet at PersistJob.java:35"]; } subgraph cluster61093 { label="WholeStageCodegen (18)"; 26795 [labelType="html" label="MapPartitionsRDD [26795]<br>parquet at PersistJob.java:35"]; } subgraph cluster61104 { label="Scan parquet "; 26796 [labelType="html" label="FileScanRDD [26796]<br>parquet at PersistJob.java:35"]; 26797 [labelType="html" label="MapPartitionsRDD [26797]<br>parquet at PersistJob.java:35"]; } subgraph cluster61099 { label="WholeStageCodegen (19)"; 26798 [labelType="html" label="MapPartitionsRDD [26798]<br>parquet at PersistJob.java:35"]; } subgraph cluster61086 { label="Union"; 26799 [labelType="html" label="UnionRDD [26799]<br>parquet at PersistJob.java:35"]; } subgraph cluster61085 { label="Exchange"; 26800 [labelType="html" label="MapPartitionsRDD [26800]<br>parquet at PersistJob.java:35"]; } } 26790->26791; 26791->26792; 26793->26794; 26794->26795; 26796->26797; 26797->26798; 26792->26799; 26795->26799; 26798->26799; 26799->26800; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time