3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32654 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.2 KiB / 489
Shuffle Write Size / Records:
7.1 KiB / 489
Associated Job Ids:
17994
DAG Visualization
digraph G { subgraph clusterstage_32654 { label="Stage 32654"; subgraph cluster208415 { label="Scan parquet "; 90199 [labelType="html" label="FileScanRDD [90199]<br>rdd at PersistJob.java:28"]; 90200 [labelType="html" label="MapPartitionsRDD [90200]<br>rdd at PersistJob.java:28"]; } subgraph cluster208410 { label="WholeStageCodegen (13)"; 90201 [labelType="html" label="MapPartitionsRDD [90201]<br>rdd at PersistJob.java:28"]; } subgraph cluster208421 { label="Scan parquet "; 90202 [labelType="html" label="FileScanRDD [90202]<br>rdd at PersistJob.java:28"]; 90203 [labelType="html" label="MapPartitionsRDD [90203]<br>rdd at PersistJob.java:28"]; } subgraph cluster208416 { label="WholeStageCodegen (14)"; 90204 [labelType="html" label="MapPartitionsRDD [90204]<br>rdd at PersistJob.java:28"]; } subgraph cluster208427 { label="Scan parquet "; 90205 [labelType="html" label="FileScanRDD [90205]<br>rdd at PersistJob.java:28"]; 90206 [labelType="html" label="MapPartitionsRDD [90206]<br>rdd at PersistJob.java:28"]; } subgraph cluster208422 { label="WholeStageCodegen (15)"; 90207 [labelType="html" label="MapPartitionsRDD [90207]<br>rdd at PersistJob.java:28"]; } subgraph cluster208409 { label="Union"; 90208 [labelType="html" label="UnionRDD [90208]<br>rdd at PersistJob.java:28"]; } subgraph cluster208408 { label="Exchange"; 90209 [labelType="html" label="MapPartitionsRDD [90209]<br>rdd at PersistJob.java:28"]; } } 90199->90200; 90200->90201; 90202->90203; 90203->90204; 90205->90206; 90206->90207; 90201->90208; 90204->90208; 90207->90208; 90208->90209; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time