3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15440 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
21.3 MiB / 605004
Output Size / Records:
113.5 MiB / 605004
Associated Job Ids:
8117
DAG Visualization
digraph G { subgraph clusterstage_15440 { label="Stage 15440"; 42114 [labelType="html" label="SQLExecutionRDD [42114]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster99796 { label="Scan parquet "; 42110 [labelType="html" label="FileScanRDD [42110]<br>toJavaRDD at AbsExportExecutor.java:55"]; 42111 [labelType="html" label="MapPartitionsRDD [42111]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster99793 { label="WholeStageCodegen (1)"; 42112 [labelType="html" label="MapPartitionsRDD [42112]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster99792 { label="DeserializeToObject"; 42113 [labelType="html" label="MapPartitionsRDD [42113]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster99797 { label="mapPartitions"; 42115 [labelType="html" label="MapPartitionsRDD [42115]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster99798 { label="map"; 42116 [labelType="html" label="MapPartitionsRDD [42116]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster99805 { label="WholeStageCodegen (1)"; 42121 [labelType="html" label="MapPartitionsRDD [42121]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster99804 { label="Coalesce"; 42122 [labelType="html" label="CoalescedRDD [42122]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster99803 { label="WriteFiles"; 42123 [labelType="html" label="MapPartitionsRDD [42123]<br>save at DataFrameCsvWriter.java:13"]; } } 42110->42111; 42111->42112; 42112->42113; 42113->42114; 42114->42115; 42115->42116; 42116->42121; 42121->42122; 42122->42123; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time