3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5617 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1116.7 KiB / 493876
Shuffle Write Size / Records:
283.0 B / 5
Associated Job Ids:
3017
DAG Visualization
digraph G { subgraph clusterstage_5617 { label="Stage 5617"; subgraph cluster35347 { label="Scan parquet "; 14641 [labelType="html" label="FileScanRDD [14641]<br>count at ColumnStatJob.java:47"]; 14642 [labelType="html" label="MapPartitionsRDD [14642]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35342 { label="WholeStageCodegen (1)"; 14643 [labelType="html" label="MapPartitionsRDD [14643]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35352 { label="Scan csv "; 14644 [labelType="html" label="FileScanRDD [14644]<br>count at ColumnStatJob.java:47"]; 14645 [labelType="html" label="MapPartitionsRDD [14645]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35348 { label="WholeStageCodegen (2)"; 14646 [labelType="html" label="MapPartitionsRDD [14646]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35341 { label="CartesianProduct"; 14647 [labelType="html" label="UnsafeCartesianRDD [14647]<br>count at ColumnStatJob.java:47"]; 14648 [labelType="html" label="MapPartitionsRDD [14648]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35338 { label="WholeStageCodegen (3)"; 14649 [labelType="html" label="MapPartitionsRDD [14649]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35337 { label="Exchange"; 14650 [labelType="html" label="MapPartitionsRDD [14650]<br>count at ColumnStatJob.java:47"]; } } 14641->14642; 14642->14643; 14644->14645; 14645->14646; 14643->14647; 14646->14647; 14647->14648; 14648->14649; 14649->14650; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time