3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5614 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 4
Input Size / Records:
887.5 KiB / 391082
Associated Job Ids:
3014
DAG Visualization
digraph G { subgraph clusterstage_5614 { label="Stage 5614"; subgraph cluster35301 { label="Scan parquet "; 14620 [labelType="html" label="FileScanRDD [14620]<br>takeAsList at DataFrameCommonJob.java:143"]; 14621 [labelType="html" label="MapPartitionsRDD [14621]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35295 { label="WholeStageCodegen (1)"; 14622 [labelType="html" label="MapPartitionsRDD [14622]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35307 { label="Scan csv "; 14623 [labelType="html" label="FileScanRDD [14623]<br>takeAsList at DataFrameCommonJob.java:143"]; 14624 [labelType="html" label="MapPartitionsRDD [14624]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35302 { label="WholeStageCodegen (2)"; 14625 [labelType="html" label="MapPartitionsRDD [14625]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35294 { label="CartesianProduct"; 14626 [labelType="html" label="UnsafeCartesianRDD [14626]<br>takeAsList at DataFrameCommonJob.java:143"]; 14627 [labelType="html" label="MapPartitionsRDD [14627]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35308 { label="mapPartitionsInternal"; 14628 [labelType="html" label="MapPartitionsRDD [14628]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 14620->14621; 14621->14622; 14623->14624; 14624->14625; 14622->14626; 14625->14626; 14626->14627; 14627->14628; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time