3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18419 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259668
Shuffle Write Size / Records:
20.9 MiB / 259658
Associated Job Ids:
9225
DAG Visualization
digraph G { subgraph clusterstage_18419 { label="Stage 18419"; subgraph cluster120240 { label="Scan parquet "; 51605 [labelType="html" label="FileScanRDD [51605]<br>takeAsList at DataFrameCommonJob.java:145"]; 51606 [labelType="html" label="MapPartitionsRDD [51606]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120236 { label="WholeStageCodegen (1)"; 51607 [labelType="html" label="MapPartitionsRDD [51607]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120245 { label="Scan csv "; 51608 [labelType="html" label="FileScanRDD [51608]<br>takeAsList at DataFrameCommonJob.java:145"]; 51609 [labelType="html" label="MapPartitionsRDD [51609]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120241 { label="WholeStageCodegen (2)"; 51610 [labelType="html" label="MapPartitionsRDD [51610]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120235 { label="CartesianProduct"; 51611 [labelType="html" label="UnsafeCartesianRDD [51611]<br>takeAsList at DataFrameCommonJob.java:145"]; 51612 [labelType="html" label="MapPartitionsRDD [51612]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120231 { label="WholeStageCodegen (3)"; 51613 [labelType="html" label="MapPartitionsRDD [51613]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120230 { label="Exchange"; 51614 [labelType="html" label="MapPartitionsRDD [51614]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51605->51606; 51606->51607; 51608->51609; 51609->51610; 51607->51611; 51610->51611; 51611->51612; 51612->51613; 51613->51614; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time