3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17237 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.5 MiB / 258304
Shuffle Write Size / Records:
20.8 MiB / 258294
Associated Job Ids:
8396
DAG Visualization
digraph G { subgraph clusterstage_17237 { label="Stage 17237"; subgraph cluster110519 { label="Scan parquet "; 47206 [labelType="html" label="FileScanRDD [47206]<br>takeAsList at DataFrameCommonJob.java:145"]; 47207 [labelType="html" label="MapPartitionsRDD [47207]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110515 { label="WholeStageCodegen (1)"; 47208 [labelType="html" label="MapPartitionsRDD [47208]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110524 { label="Scan csv "; 47209 [labelType="html" label="FileScanRDD [47209]<br>takeAsList at DataFrameCommonJob.java:145"]; 47210 [labelType="html" label="MapPartitionsRDD [47210]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110520 { label="WholeStageCodegen (2)"; 47211 [labelType="html" label="MapPartitionsRDD [47211]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110514 { label="CartesianProduct"; 47212 [labelType="html" label="UnsafeCartesianRDD [47212]<br>takeAsList at DataFrameCommonJob.java:145"]; 47213 [labelType="html" label="MapPartitionsRDD [47213]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110510 { label="WholeStageCodegen (3)"; 47214 [labelType="html" label="MapPartitionsRDD [47214]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110509 { label="Exchange"; 47215 [labelType="html" label="MapPartitionsRDD [47215]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 47206->47207; 47207->47208; 47209->47210; 47210->47211; 47208->47212; 47211->47212; 47212->47213; 47213->47214; 47214->47215; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time