3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18354 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259668
Shuffle Write Size / Records:
20.9 MiB / 259658
Associated Job Ids:
9194
DAG Visualization
digraph G { subgraph clusterstage_18354 { label="Stage 18354"; subgraph cluster119760 { label="Scan parquet "; 51421 [labelType="html" label="FileScanRDD [51421]<br>takeAsList at DataFrameCommonJob.java:145"]; 51422 [labelType="html" label="MapPartitionsRDD [51422]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119756 { label="WholeStageCodegen (1)"; 51423 [labelType="html" label="MapPartitionsRDD [51423]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119765 { label="Scan csv "; 51424 [labelType="html" label="FileScanRDD [51424]<br>takeAsList at DataFrameCommonJob.java:145"]; 51425 [labelType="html" label="MapPartitionsRDD [51425]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119761 { label="WholeStageCodegen (2)"; 51426 [labelType="html" label="MapPartitionsRDD [51426]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119755 { label="CartesianProduct"; 51427 [labelType="html" label="UnsafeCartesianRDD [51427]<br>takeAsList at DataFrameCommonJob.java:145"]; 51428 [labelType="html" label="MapPartitionsRDD [51428]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119751 { label="WholeStageCodegen (3)"; 51429 [labelType="html" label="MapPartitionsRDD [51429]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119750 { label="Exchange"; 51430 [labelType="html" label="MapPartitionsRDD [51430]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51421->51422; 51422->51423; 51424->51425; 51425->51426; 51423->51427; 51426->51427; 51427->51428; 51428->51429; 51429->51430; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time