3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16397 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
21.3 MiB / 603650
Output Size / Records:
113.3 MiB / 603650
Associated Job Ids:
8020
DAG Visualization
digraph G { subgraph clusterstage_16397 { label="Stage 16397"; 44861 [labelType="html" label="SQLExecutionRDD [44861]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster105133 { label="Scan parquet "; 44857 [labelType="html" label="FileScanRDD [44857]<br>toJavaRDD at AbsExportExecutor.java:55"]; 44858 [labelType="html" label="MapPartitionsRDD [44858]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster105130 { label="WholeStageCodegen (1)"; 44859 [labelType="html" label="MapPartitionsRDD [44859]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster105129 { label="DeserializeToObject"; 44860 [labelType="html" label="MapPartitionsRDD [44860]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster105134 { label="mapPartitions"; 44862 [labelType="html" label="MapPartitionsRDD [44862]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster105135 { label="map"; 44863 [labelType="html" label="MapPartitionsRDD [44863]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster105142 { label="WholeStageCodegen (1)"; 44868 [labelType="html" label="MapPartitionsRDD [44868]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster105141 { label="Coalesce"; 44869 [labelType="html" label="CoalescedRDD [44869]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster105140 { label="WriteFiles"; 44870 [labelType="html" label="MapPartitionsRDD [44870]<br>save at DataFrameCsvWriter.java:13"]; } } 44857->44858; 44858->44859; 44859->44860; 44860->44861; 44861->44862; 44862->44863; 44863->44868; 44868->44869; 44869->44870; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time