3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15263 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
961.0 KiB / 6263
Shuffle Write Size / Records:
482.7 KiB / 6253
Associated Job Ids:
7714
DAG Visualization
digraph G { subgraph clusterstage_15263 { label="Stage 15263"; subgraph cluster99294 { label="Scan parquet "; 42218 [labelType="html" label="FileScanRDD [42218]<br>takeAsList at DataFrameCommonJob.java:145"]; 42219 [labelType="html" label="MapPartitionsRDD [42219]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99289 { label="WholeStageCodegen (1)"; 42220 [labelType="html" label="MapPartitionsRDD [42220]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99299 { label="Scan csv "; 42221 [labelType="html" label="FileScanRDD [42221]<br>takeAsList at DataFrameCommonJob.java:145"]; 42222 [labelType="html" label="MapPartitionsRDD [42222]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99295 { label="WholeStageCodegen (2)"; 42223 [labelType="html" label="MapPartitionsRDD [42223]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99288 { label="CartesianProduct"; 42224 [labelType="html" label="UnsafeCartesianRDD [42224]<br>takeAsList at DataFrameCommonJob.java:145"]; 42225 [labelType="html" label="MapPartitionsRDD [42225]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99280 { label="WholeStageCodegen (3)"; 42226 [labelType="html" label="MapPartitionsRDD [42226]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99279 { label="Exchange"; 42227 [labelType="html" label="MapPartitionsRDD [42227]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42218->42219; 42219->42220; 42221->42222; 42222->42223; 42220->42224; 42223->42224; 42224->42225; 42225->42226; 42226->42227; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time