3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16123 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.2 KiB / 532
Associated Job Ids:
8132
DAG Visualization
digraph G { subgraph clusterstage_16123 { label="Stage 16123"; subgraph cluster105426 { label="Scan parquet "; 45294 [labelType="html" label="FileScanRDD [45294]<br>parquet at PersistJob.java:35"]; 45295 [labelType="html" label="MapPartitionsRDD [45295]<br>parquet at PersistJob.java:35"]; } subgraph cluster105421 { label="WholeStageCodegen (17)"; 45296 [labelType="html" label="MapPartitionsRDD [45296]<br>parquet at PersistJob.java:35"]; } subgraph cluster105432 { label="Scan parquet "; 45297 [labelType="html" label="FileScanRDD [45297]<br>parquet at PersistJob.java:35"]; 45298 [labelType="html" label="MapPartitionsRDD [45298]<br>parquet at PersistJob.java:35"]; } subgraph cluster105427 { label="WholeStageCodegen (18)"; 45299 [labelType="html" label="MapPartitionsRDD [45299]<br>parquet at PersistJob.java:35"]; } subgraph cluster105438 { label="Scan parquet "; 45300 [labelType="html" label="FileScanRDD [45300]<br>parquet at PersistJob.java:35"]; 45301 [labelType="html" label="MapPartitionsRDD [45301]<br>parquet at PersistJob.java:35"]; } subgraph cluster105433 { label="WholeStageCodegen (19)"; 45302 [labelType="html" label="MapPartitionsRDD [45302]<br>parquet at PersistJob.java:35"]; } subgraph cluster105420 { label="Union"; 45303 [labelType="html" label="UnionRDD [45303]<br>parquet at PersistJob.java:35"]; } subgraph cluster105419 { label="Exchange"; 45304 [labelType="html" label="MapPartitionsRDD [45304]<br>parquet at PersistJob.java:35"]; } } 45294->45295; 45295->45296; 45297->45298; 45298->45299; 45300->45301; 45301->45302; 45296->45303; 45299->45303; 45302->45303; 45303->45304; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time