3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8607 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.2 min
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
83.2 MiB / 2132018
Shuffle Read Size / Records:
10.4 MiB / 262408
Shuffle Write Size / Records:
1180.0 B / 20
Associated Job Ids:
4257
DAG Visualization
digraph G { subgraph clusterstage_8607 { label="Stage 8607"; subgraph cluster56354 { label="Exchange"; 24703 [labelType="html" label="ShuffledRowRDD [24703] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56350 { label="WholeStageCodegen (18)"; 24704 [labelType="html" label="MapPartitionsRDD [24704] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56349 { label="Window"; 24705 [labelType="html" label="MapPartitionsRDD [24705] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56316 { label="WholeStageCodegen (19)"; 24706 [labelType="html" label="MapPartitionsRDD [24706] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56360 { label="Scan parquet "; 24707 [labelType="html" label="FileScanRDD [24707]<br>count at ColumnStatJob.java:47"]; 24708 [labelType="html" label="MapPartitionsRDD [24708]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56355 { label="WholeStageCodegen (20)"; 24709 [labelType="html" label="MapPartitionsRDD [24709]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56315 { label="Union"; 24710 [labelType="html" label="UnionRDD [24710] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56312 { label="WholeStageCodegen (21)"; 24711 [labelType="html" label="MapPartitionsRDD [24711] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56311 { label="Exchange"; 24712 [labelType="html" label="MapPartitionsRDD [24712] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 24703->24704; 24704->24705; 24705->24706; 24707->24708; 24708->24709; 24706->24710; 24709->24710; 24710->24711; 24711->24712; }
24667,24703
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time