3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44456 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.7 MiB / 350145
Shuffle Write Size / Records:
21.4 MiB / 299977
Associated Job Ids:
23557
DAG Visualization
digraph G { subgraph clusterstage_44456 { label="Stage 44456"; subgraph cluster306220 { label="Scan parquet "; 134214 [labelType="html" label="FileScanRDD [134214]<br>takeAsList at DataFrameCommonJob.java:145"]; 134215 [labelType="html" label="MapPartitionsRDD [134215]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306215 { label="WholeStageCodegen (1)"; 134216 [labelType="html" label="MapPartitionsRDD [134216]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306225 { label="Scan csv "; 134217 [labelType="html" label="FileScanRDD [134217]<br>takeAsList at DataFrameCommonJob.java:145"]; 134218 [labelType="html" label="MapPartitionsRDD [134218]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306221 { label="WholeStageCodegen (2)"; 134219 [labelType="html" label="MapPartitionsRDD [134219]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306214 { label="CartesianProduct"; 134220 [labelType="html" label="UnsafeCartesianRDD [134220]<br>takeAsList at DataFrameCommonJob.java:145"]; 134221 [labelType="html" label="MapPartitionsRDD [134221]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306211 { label="WholeStageCodegen (3)"; 134222 [labelType="html" label="MapPartitionsRDD [134222]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306210 { label="Exchange"; 134223 [labelType="html" label="MapPartitionsRDD [134223]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134214->134215; 134215->134216; 134217->134218; 134218->134219; 134216->134220; 134219->134220; 134220->134221; 134221->134222; 134222->134223; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time