3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8097 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
50 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
523.0 B / 7
Associated Job Ids:
3832
DAG Visualization
digraph G { subgraph clusterstage_8097 { label="Stage 8097"; subgraph cluster50054 { label="Scan parquet "; 21568 [labelType="html" label="FileScanRDD [21568]<br>takeAsList at DataFrameCommonJob.java:145"]; 21569 [labelType="html" label="MapPartitionsRDD [21569]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50049 { label="WholeStageCodegen (1)"; 21570 [labelType="html" label="MapPartitionsRDD [21570]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50059 { label="Scan csv "; 21571 [labelType="html" label="FileScanRDD [21571]<br>takeAsList at DataFrameCommonJob.java:145"]; 21572 [labelType="html" label="MapPartitionsRDD [21572]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50055 { label="WholeStageCodegen (2)"; 21573 [labelType="html" label="MapPartitionsRDD [21573]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50048 { label="CartesianProduct"; 21574 [labelType="html" label="UnsafeCartesianRDD [21574]<br>takeAsList at DataFrameCommonJob.java:145"]; 21575 [labelType="html" label="MapPartitionsRDD [21575]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50045 { label="WholeStageCodegen (3)"; 21576 [labelType="html" label="MapPartitionsRDD [21576]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster50044 { label="Exchange"; 21577 [labelType="html" label="MapPartitionsRDD [21577]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 21568->21569; 21569->21570; 21571->21572; 21572->21573; 21570->21574; 21573->21574; 21574->21575; 21575->21576; 21576->21577; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time