3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44594 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 10
Input Size / Records:
3.7 MiB / 350145
Shuffle Write Size / Records:
8.4 MiB / 299977
Associated Job Ids:
23639
DAG Visualization
digraph G { subgraph clusterstage_44594 { label="Stage 44594"; subgraph cluster307360 { label="Scan parquet "; 134666 [labelType="html" label="FileScanRDD [134666]<br>takeAsList at DataFrameCommonJob.java:145"]; 134667 [labelType="html" label="MapPartitionsRDD [134667]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307355 { label="WholeStageCodegen (1)"; 134668 [labelType="html" label="MapPartitionsRDD [134668]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307365 { label="Scan csv "; 134669 [labelType="html" label="FileScanRDD [134669]<br>takeAsList at DataFrameCommonJob.java:145"]; 134670 [labelType="html" label="MapPartitionsRDD [134670]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307361 { label="WholeStageCodegen (2)"; 134671 [labelType="html" label="MapPartitionsRDD [134671]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307354 { label="CartesianProduct"; 134672 [labelType="html" label="UnsafeCartesianRDD [134672]<br>takeAsList at DataFrameCommonJob.java:145"]; 134673 [labelType="html" label="MapPartitionsRDD [134673]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307350 { label="WholeStageCodegen (3)"; 134674 [labelType="html" label="MapPartitionsRDD [134674]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307349 { label="Exchange"; 134675 [labelType="html" label="MapPartitionsRDD [134675]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134666->134667; 134667->134668; 134669->134670; 134670->134671; 134668->134672; 134671->134672; 134672->134673; 134673->134674; 134674->134675; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time