3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5735 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1116.7 KiB / 493876
Shuffle Write Size / Records:
2.0 MiB / 493871
Associated Job Ids:
3086
DAG Visualization
digraph G { subgraph clusterstage_5735 { label="Stage 5735"; subgraph cluster36378 { label="Scan parquet "; 15062 [labelType="html" label="FileScanRDD [15062]<br>takeAsList at DataFrameCommonJob.java:143"]; 15063 [labelType="html" label="MapPartitionsRDD [15063]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36374 { label="WholeStageCodegen (1)"; 15064 [labelType="html" label="MapPartitionsRDD [15064]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36383 { label="Scan csv "; 15065 [labelType="html" label="FileScanRDD [15065]<br>takeAsList at DataFrameCommonJob.java:143"]; 15066 [labelType="html" label="MapPartitionsRDD [15066]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36379 { label="WholeStageCodegen (2)"; 15067 [labelType="html" label="MapPartitionsRDD [15067]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36373 { label="CartesianProduct"; 15068 [labelType="html" label="UnsafeCartesianRDD [15068]<br>takeAsList at DataFrameCommonJob.java:143"]; 15069 [labelType="html" label="MapPartitionsRDD [15069]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36370 { label="WholeStageCodegen (3)"; 15070 [labelType="html" label="MapPartitionsRDD [15070]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36369 { label="Exchange"; 15071 [labelType="html" label="MapPartitionsRDD [15071]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 15062->15063; 15063->15064; 15065->15066; 15066->15067; 15064->15068; 15067->15068; 15068->15069; 15069->15070; 15070->15071; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time