3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8277 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
4088
DAG Visualization
digraph G { subgraph clusterstage_8277 { label="Stage 8277"; subgraph cluster54141 { label="Scan parquet "; 23797 [labelType="html" label="FileScanRDD [23797]<br>rdd at PersistJob.java:28"]; 23798 [labelType="html" label="MapPartitionsRDD [23798]<br>rdd at PersistJob.java:28"]; } subgraph cluster54136 { label="WholeStageCodegen (13)"; 23799 [labelType="html" label="MapPartitionsRDD [23799]<br>rdd at PersistJob.java:28"]; } subgraph cluster54147 { label="Scan parquet "; 23800 [labelType="html" label="FileScanRDD [23800]<br>rdd at PersistJob.java:28"]; 23801 [labelType="html" label="MapPartitionsRDD [23801]<br>rdd at PersistJob.java:28"]; } subgraph cluster54142 { label="WholeStageCodegen (14)"; 23802 [labelType="html" label="MapPartitionsRDD [23802]<br>rdd at PersistJob.java:28"]; } subgraph cluster54153 { label="Scan parquet "; 23803 [labelType="html" label="FileScanRDD [23803]<br>rdd at PersistJob.java:28"]; 23804 [labelType="html" label="MapPartitionsRDD [23804]<br>rdd at PersistJob.java:28"]; } subgraph cluster54148 { label="WholeStageCodegen (15)"; 23805 [labelType="html" label="MapPartitionsRDD [23805]<br>rdd at PersistJob.java:28"]; } subgraph cluster54135 { label="Union"; 23806 [labelType="html" label="UnionRDD [23806]<br>rdd at PersistJob.java:28"]; } subgraph cluster54134 { label="Exchange"; 23807 [labelType="html" label="MapPartitionsRDD [23807]<br>rdd at PersistJob.java:28"]; } } 23797->23798; 23798->23799; 23800->23801; 23801->23802; 23803->23804; 23804->23805; 23799->23806; 23802->23806; 23805->23806; 23806->23807; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time