3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18491 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259668
Shuffle Write Size / Records:
20.9 MiB / 259658
Associated Job Ids:
9255
DAG Visualization
digraph G { subgraph clusterstage_18491 { label="Stage 18491"; subgraph cluster120750 { label="Scan parquet "; 51798 [labelType="html" label="FileScanRDD [51798]<br>takeAsList at DataFrameCommonJob.java:145"]; 51799 [labelType="html" label="MapPartitionsRDD [51799]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120746 { label="WholeStageCodegen (1)"; 51800 [labelType="html" label="MapPartitionsRDD [51800]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120755 { label="Scan csv "; 51801 [labelType="html" label="FileScanRDD [51801]<br>takeAsList at DataFrameCommonJob.java:145"]; 51802 [labelType="html" label="MapPartitionsRDD [51802]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120751 { label="WholeStageCodegen (2)"; 51803 [labelType="html" label="MapPartitionsRDD [51803]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120745 { label="CartesianProduct"; 51804 [labelType="html" label="UnsafeCartesianRDD [51804]<br>takeAsList at DataFrameCommonJob.java:145"]; 51805 [labelType="html" label="MapPartitionsRDD [51805]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120741 { label="WholeStageCodegen (3)"; 51806 [labelType="html" label="MapPartitionsRDD [51806]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120740 { label="Exchange"; 51807 [labelType="html" label="MapPartitionsRDD [51807]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51798->51799; 51799->51800; 51801->51802; 51802->51803; 51800->51804; 51803->51804; 51804->51805; 51805->51806; 51806->51807; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time