3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44539 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.4 MiB / 350145
Shuffle Write Size / Records:
24.9 MiB / 299977
Associated Job Ids:
23612
DAG Visualization
digraph G { subgraph clusterstage_44539 { label="Stage 44539"; subgraph cluster307033 { label="Scan parquet "; 134531 [labelType="html" label="FileScanRDD [134531]<br>takeAsList at DataFrameCommonJob.java:145"]; 134532 [labelType="html" label="MapPartitionsRDD [134532]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307028 { label="WholeStageCodegen (1)"; 134533 [labelType="html" label="MapPartitionsRDD [134533]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307038 { label="Scan csv "; 134534 [labelType="html" label="FileScanRDD [134534]<br>takeAsList at DataFrameCommonJob.java:145"]; 134535 [labelType="html" label="MapPartitionsRDD [134535]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307034 { label="WholeStageCodegen (2)"; 134536 [labelType="html" label="MapPartitionsRDD [134536]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307027 { label="CartesianProduct"; 134537 [labelType="html" label="UnsafeCartesianRDD [134537]<br>takeAsList at DataFrameCommonJob.java:145"]; 134538 [labelType="html" label="MapPartitionsRDD [134538]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307023 { label="WholeStageCodegen (3)"; 134539 [labelType="html" label="MapPartitionsRDD [134539]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307022 { label="Exchange"; 134540 [labelType="html" label="MapPartitionsRDD [134540]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134531->134532; 134532->134533; 134534->134535; 134535->134536; 134533->134537; 134536->134537; 134537->134538; 134538->134539; 134539->134540; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time