3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15238 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 5
Input Size / Records:
628.6 KiB / 3056
Associated Job Ids:
7697
DAG Visualization
digraph G { subgraph clusterstage_15238 { label="Stage 15238"; subgraph cluster99092 { label="Scan parquet "; 42112 [labelType="html" label="FileScanRDD [42112]<br>takeAsList at DataFrameCommonJob.java:145"]; 42113 [labelType="html" label="MapPartitionsRDD [42113]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99088 { label="WholeStageCodegen (1)"; 42114 [labelType="html" label="MapPartitionsRDD [42114]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99097 { label="Scan csv "; 42115 [labelType="html" label="FileScanRDD [42115]<br>takeAsList at DataFrameCommonJob.java:145"]; 42116 [labelType="html" label="MapPartitionsRDD [42116]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99093 { label="WholeStageCodegen (2)"; 42117 [labelType="html" label="MapPartitionsRDD [42117]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99087 { label="CartesianProduct"; 42118 [labelType="html" label="UnsafeCartesianRDD [42118]<br>takeAsList at DataFrameCommonJob.java:145"]; 42119 [labelType="html" label="MapPartitionsRDD [42119]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99084 { label="WholeStageCodegen (3)"; 42120 [labelType="html" label="MapPartitionsRDD [42120]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster99098 { label="mapPartitionsInternal"; 42121 [labelType="html" label="MapPartitionsRDD [42121]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 42112->42113; 42113->42114; 42115->42116; 42116->42117; 42114->42118; 42117->42118; 42118->42119; 42119->42120; 42120->42121; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time