3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9204 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
8.3 KiB / 532
Associated Job Ids:
4715
DAG Visualization
digraph G { subgraph clusterstage_9204 { label="Stage 9204"; subgraph cluster60619 { label="Scan parquet "; 26511 [labelType="html" label="FileScanRDD [26511]<br>rdd at PersistJob.java:28"]; 26512 [labelType="html" label="MapPartitionsRDD [26512]<br>rdd at PersistJob.java:28"]; } subgraph cluster60614 { label="WholeStageCodegen (17)"; 26513 [labelType="html" label="MapPartitionsRDD [26513]<br>rdd at PersistJob.java:28"]; } subgraph cluster60625 { label="Scan parquet "; 26514 [labelType="html" label="FileScanRDD [26514]<br>rdd at PersistJob.java:28"]; 26515 [labelType="html" label="MapPartitionsRDD [26515]<br>rdd at PersistJob.java:28"]; } subgraph cluster60620 { label="WholeStageCodegen (18)"; 26516 [labelType="html" label="MapPartitionsRDD [26516]<br>rdd at PersistJob.java:28"]; } subgraph cluster60631 { label="Scan parquet "; 26517 [labelType="html" label="FileScanRDD [26517]<br>rdd at PersistJob.java:28"]; 26518 [labelType="html" label="MapPartitionsRDD [26518]<br>rdd at PersistJob.java:28"]; } subgraph cluster60626 { label="WholeStageCodegen (19)"; 26519 [labelType="html" label="MapPartitionsRDD [26519]<br>rdd at PersistJob.java:28"]; } subgraph cluster60613 { label="Union"; 26520 [labelType="html" label="UnionRDD [26520]<br>rdd at PersistJob.java:28"]; } subgraph cluster60612 { label="Exchange"; 26521 [labelType="html" label="MapPartitionsRDD [26521]<br>rdd at PersistJob.java:28"]; } } 26511->26512; 26512->26513; 26514->26515; 26515->26516; 26517->26518; 26518->26519; 26513->26520; 26516->26520; 26519->26520; 26520->26521; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time