3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13558 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
94 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.2 KiB / 532
Associated Job Ids:
6798
DAG Visualization
digraph G { subgraph clusterstage_13558 { label="Stage 13558"; subgraph cluster88254 { label="Scan parquet "; 37528 [labelType="html" label="FileScanRDD [37528]<br>rdd at PersistJob.java:28"]; 37529 [labelType="html" label="MapPartitionsRDD [37529]<br>rdd at PersistJob.java:28"]; } subgraph cluster88249 { label="WholeStageCodegen (17)"; 37530 [labelType="html" label="MapPartitionsRDD [37530]<br>rdd at PersistJob.java:28"]; } subgraph cluster88260 { label="Scan parquet "; 37531 [labelType="html" label="FileScanRDD [37531]<br>rdd at PersistJob.java:28"]; 37532 [labelType="html" label="MapPartitionsRDD [37532]<br>rdd at PersistJob.java:28"]; } subgraph cluster88255 { label="WholeStageCodegen (18)"; 37533 [labelType="html" label="MapPartitionsRDD [37533]<br>rdd at PersistJob.java:28"]; } subgraph cluster88266 { label="Scan parquet "; 37534 [labelType="html" label="FileScanRDD [37534]<br>rdd at PersistJob.java:28"]; 37535 [labelType="html" label="MapPartitionsRDD [37535]<br>rdd at PersistJob.java:28"]; } subgraph cluster88261 { label="WholeStageCodegen (19)"; 37536 [labelType="html" label="MapPartitionsRDD [37536]<br>rdd at PersistJob.java:28"]; } subgraph cluster88248 { label="Union"; 37537 [labelType="html" label="UnionRDD [37537]<br>rdd at PersistJob.java:28"]; } subgraph cluster88247 { label="Exchange"; 37538 [labelType="html" label="MapPartitionsRDD [37538]<br>rdd at PersistJob.java:28"]; } } 37528->37529; 37529->37530; 37531->37532; 37532->37533; 37534->37535; 37535->37536; 37530->37537; 37533->37537; 37536->37537; 37537->37538; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time