3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17286 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 1
Input Size / Records:
77.8 MiB / 2127386
Output Size / Records:
384.0 MiB / 2127386
Associated Job Ids:
8408
DAG Visualization
digraph G { subgraph clusterstage_17286 { label="Stage 17286"; 47311 [labelType="html" label="SQLExecutionRDD [47311]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster110849 { label="Scan parquet "; 47307 [labelType="html" label="FileScanRDD [47307]<br>toJavaRDD at AbsExportExecutor.java:55"]; 47308 [labelType="html" label="MapPartitionsRDD [47308]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster110846 { label="WholeStageCodegen (1)"; 47309 [labelType="html" label="MapPartitionsRDD [47309]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster110845 { label="DeserializeToObject"; 47310 [labelType="html" label="MapPartitionsRDD [47310]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster110850 { label="mapPartitions"; 47312 [labelType="html" label="MapPartitionsRDD [47312]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster110851 { label="map"; 47313 [labelType="html" label="MapPartitionsRDD [47313]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster110858 { label="WholeStageCodegen (1)"; 47318 [labelType="html" label="MapPartitionsRDD [47318]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster110857 { label="Coalesce"; 47319 [labelType="html" label="CoalescedRDD [47319]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster110856 { label="WriteFiles"; 47320 [labelType="html" label="MapPartitionsRDD [47320]<br>save at DataFrameCsvWriter.java:13"]; } } 47307->47308; 47308->47309; 47309->47310; 47310->47311; 47311->47312; 47312->47313; 47313->47318; 47318->47319; 47319->47320; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time