3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15308 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 10
Input Size / Records:
742.7 KiB / 6263
Shuffle Write Size / Records:
489.2 KiB / 6253
Associated Job Ids:
7737
DAG Visualization
digraph G { subgraph clusterstage_15308 { label="Stage 15308"; subgraph cluster99647 { label="Scan parquet "; 42362 [labelType="html" label="FileScanRDD [42362]<br>takeAsList at DataFrameCommonJob.java:145"]; 42363 [labelType="html" label="MapPartitionsRDD [42363]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99643 { label="WholeStageCodegen (1)"; 42364 [labelType="html" label="MapPartitionsRDD [42364]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99652 { label="Scan csv "; 42365 [labelType="html" label="FileScanRDD [42365]<br>takeAsList at DataFrameCommonJob.java:145"]; 42366 [labelType="html" label="MapPartitionsRDD [42366]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99648 { label="WholeStageCodegen (2)"; 42367 [labelType="html" label="MapPartitionsRDD [42367]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99642 { label="CartesianProduct"; 42368 [labelType="html" label="UnsafeCartesianRDD [42368]<br>takeAsList at DataFrameCommonJob.java:145"]; 42369 [labelType="html" label="MapPartitionsRDD [42369]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99634 { label="WholeStageCodegen (3)"; 42370 [labelType="html" label="MapPartitionsRDD [42370]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99633 { label="Exchange"; 42371 [labelType="html" label="MapPartitionsRDD [42371]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42362->42363; 42363->42364; 42365->42366; 42366->42367; 42364->42368; 42367->42368; 42368->42369; 42369->42370; 42370->42371; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time