3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44430 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.4 MiB / 350145
Shuffle Write Size / Records:
24.9 MiB / 299977
Associated Job Ids:
23544
DAG Visualization
digraph G { subgraph clusterstage_44430 { label="Stage 44430"; subgraph cluster306064 { label="Scan parquet "; 134149 [labelType="html" label="FileScanRDD [134149]<br>takeAsList at DataFrameCommonJob.java:145"]; 134150 [labelType="html" label="MapPartitionsRDD [134150]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306059 { label="WholeStageCodegen (1)"; 134151 [labelType="html" label="MapPartitionsRDD [134151]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306069 { label="Scan csv "; 134152 [labelType="html" label="FileScanRDD [134152]<br>takeAsList at DataFrameCommonJob.java:145"]; 134153 [labelType="html" label="MapPartitionsRDD [134153]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306065 { label="WholeStageCodegen (2)"; 134154 [labelType="html" label="MapPartitionsRDD [134154]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306058 { label="CartesianProduct"; 134155 [labelType="html" label="UnsafeCartesianRDD [134155]<br>takeAsList at DataFrameCommonJob.java:145"]; 134156 [labelType="html" label="MapPartitionsRDD [134156]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306054 { label="WholeStageCodegen (3)"; 134157 [labelType="html" label="MapPartitionsRDD [134157]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306053 { label="Exchange"; 134158 [labelType="html" label="MapPartitionsRDD [134158]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134149->134150; 134150->134151; 134152->134153; 134153->134154; 134151->134155; 134154->134155; 134155->134156; 134156->134157; 134157->134158; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time