3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5703 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1116.7 KiB / 493876
Shuffle Write Size / Records:
2.0 MiB / 493871
Associated Job Ids:
3070
DAG Visualization
digraph G { subgraph clusterstage_5703 { label="Stage 5703"; subgraph cluster36090 { label="Scan parquet "; 14964 [labelType="html" label="FileScanRDD [14964]<br>takeAsList at DataFrameCommonJob.java:143"]; 14965 [labelType="html" label="MapPartitionsRDD [14965]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36086 { label="WholeStageCodegen (1)"; 14966 [labelType="html" label="MapPartitionsRDD [14966]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36095 { label="Scan csv "; 14967 [labelType="html" label="FileScanRDD [14967]<br>takeAsList at DataFrameCommonJob.java:143"]; 14968 [labelType="html" label="MapPartitionsRDD [14968]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36091 { label="WholeStageCodegen (2)"; 14969 [labelType="html" label="MapPartitionsRDD [14969]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36085 { label="CartesianProduct"; 14970 [labelType="html" label="UnsafeCartesianRDD [14970]<br>takeAsList at DataFrameCommonJob.java:143"]; 14971 [labelType="html" label="MapPartitionsRDD [14971]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36082 { label="WholeStageCodegen (3)"; 14972 [labelType="html" label="MapPartitionsRDD [14972]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster36081 { label="Exchange"; 14973 [labelType="html" label="MapPartitionsRDD [14973]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 14964->14965; 14965->14966; 14967->14968; 14968->14969; 14966->14970; 14969->14970; 14970->14971; 14971->14972; 14972->14973; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time