3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18452 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.3 min
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
83.2 MiB / 2133238
Shuffle Read Size / Records:
10.4 MiB / 262581
Shuffle Write Size / Records:
1180.0 B / 20
Associated Job Ids:
9234
DAG Visualization
digraph G { subgraph clusterstage_18452 { label="Stage 18452"; subgraph cluster120411 { label="Exchange"; 51683 [labelType="html" label="ShuffledRowRDD [51683] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120407 { label="WholeStageCodegen (18)"; 51684 [labelType="html" label="MapPartitionsRDD [51684] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120406 { label="Window"; 51685 [labelType="html" label="MapPartitionsRDD [51685] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120392 { label="WholeStageCodegen (19)"; 51686 [labelType="html" label="MapPartitionsRDD [51686] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120417 { label="Scan parquet "; 51687 [labelType="html" label="FileScanRDD [51687]<br>count at ColumnStatJob.java:47"]; 51688 [labelType="html" label="MapPartitionsRDD [51688]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120412 { label="WholeStageCodegen (20)"; 51689 [labelType="html" label="MapPartitionsRDD [51689]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120391 { label="Union"; 51690 [labelType="html" label="UnionRDD [51690] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120388 { label="WholeStageCodegen (21)"; 51691 [labelType="html" label="MapPartitionsRDD [51691] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120387 { label="Exchange"; 51692 [labelType="html" label="MapPartitionsRDD [51692] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 51683->51684; 51684->51685; 51685->51686; 51687->51688; 51688->51689; 51686->51690; 51689->51690; 51690->51691; 51691->51692; }
51664,51683
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time