3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8124 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
66 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
523.0 B / 7
Associated Job Ids:
3847
DAG Visualization
digraph G { subgraph clusterstage_8124 { label="Stage 8124"; subgraph cluster50295 { label="Scan parquet "; 21661 [labelType="html" label="FileScanRDD [21661]<br>takeAsList at DataFrameCommonJob.java:145"]; 21662 [labelType="html" label="MapPartitionsRDD [21662]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50290 { label="WholeStageCodegen (1)"; 21663 [labelType="html" label="MapPartitionsRDD [21663]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50300 { label="Scan csv "; 21664 [labelType="html" label="FileScanRDD [21664]<br>takeAsList at DataFrameCommonJob.java:145"]; 21665 [labelType="html" label="MapPartitionsRDD [21665]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50296 { label="WholeStageCodegen (2)"; 21666 [labelType="html" label="MapPartitionsRDD [21666]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50289 { label="CartesianProduct"; 21667 [labelType="html" label="UnsafeCartesianRDD [21667]<br>takeAsList at DataFrameCommonJob.java:145"]; 21668 [labelType="html" label="MapPartitionsRDD [21668]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50286 { label="WholeStageCodegen (3)"; 21669 [labelType="html" label="MapPartitionsRDD [21669]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50285 { label="Exchange"; 21670 [labelType="html" label="MapPartitionsRDD [21670]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 21661->21662; 21662->21663; 21664->21665; 21665->21666; 21663->21667; 21666->21667; 21667->21668; 21668->21669; 21669->21670; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time