3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 12310 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
37.1 MiB / 11
Shuffle Write Size / Records:
156.0 B / 1
Associated Job Ids:
5301
DAG Visualization
digraph G { subgraph clusterstage_12310 { label="Stage 12310"; subgraph cluster71179 { label="Scan csv "; 30063 [labelType="html" label="FileScanRDD [30063]<br>takeAsList at DataFrameCommonJob.java:145"]; 30064 [labelType="html" label="MapPartitionsRDD [30064]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71174 { label="WholeStageCodegen (1)"; 30065 [labelType="html" label="MapPartitionsRDD [30065]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71185 { label="Scan csv "; 30066 [labelType="html" label="FileScanRDD [30066]<br>takeAsList at DataFrameCommonJob.java:145"]; 30067 [labelType="html" label="MapPartitionsRDD [30067]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71180 { label="WholeStageCodegen (2)"; 30068 [labelType="html" label="MapPartitionsRDD [30068]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71173 { label="CartesianProduct"; 30069 [labelType="html" label="UnsafeCartesianRDD [30069]<br>takeAsList at DataFrameCommonJob.java:145"]; 30070 [labelType="html" label="MapPartitionsRDD [30070]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71170 { label="WholeStageCodegen (3)"; 30071 [labelType="html" label="MapPartitionsRDD [30071]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster71169 { label="Exchange"; 30072 [labelType="html" label="MapPartitionsRDD [30072]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 30063->30064; 30064->30065; 30066->30067; 30067->30068; 30065->30069; 30068->30069; 30069->30070; 30070->30071; 30071->30072; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time