3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17354 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
21.3 MiB / 601976
Output Size / Records:
113.0 MiB / 601976
Associated Job Ids:
8698
DAG Visualization
digraph G { subgraph clusterstage_17354 { label="Stage 17354"; 48636 [labelType="html" label="SQLExecutionRDD [48636]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster113315 { label="Scan parquet "; 48632 [labelType="html" label="FileScanRDD [48632]<br>toJavaRDD at AbsExportExecutor.java:55"]; 48633 [labelType="html" label="MapPartitionsRDD [48633]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster113312 { label="WholeStageCodegen (1)"; 48634 [labelType="html" label="MapPartitionsRDD [48634]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster113311 { label="DeserializeToObject"; 48635 [labelType="html" label="MapPartitionsRDD [48635]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster113316 { label="mapPartitions"; 48637 [labelType="html" label="MapPartitionsRDD [48637]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster113317 { label="map"; 48638 [labelType="html" label="MapPartitionsRDD [48638]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster113324 { label="WholeStageCodegen (1)"; 48643 [labelType="html" label="MapPartitionsRDD [48643]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster113323 { label="Coalesce"; 48644 [labelType="html" label="CoalescedRDD [48644]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster113322 { label="WriteFiles"; 48645 [labelType="html" label="MapPartitionsRDD [48645]<br>save at DataFrameCsvWriter.java:13"]; } } 48632->48633; 48633->48634; 48634->48635; 48635->48636; 48636->48637; 48637->48638; 48638->48643; 48643->48644; 48644->48645; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time