3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17267 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.7 min
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
82.9 MiB / 2124462
Shuffle Read Size / Records:
10.3 MiB / 261221
Shuffle Write Size / Records:
1180.0 B / 20
Associated Job Ids:
8404
DAG Visualization
digraph G { subgraph clusterstage_17267 { label="Stage 17267"; subgraph cluster110673 { label="Exchange"; 47277 [labelType="html" label="ShuffledRowRDD [47277] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110659 { label="WholeStageCodegen (18)"; 47278 [labelType="html" label="MapPartitionsRDD [47278] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110658 { label="Window"; 47279 [labelType="html" label="MapPartitionsRDD [47279] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110654 { label="WholeStageCodegen (19)"; 47280 [labelType="html" label="MapPartitionsRDD [47280] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110679 { label="Scan parquet "; 47281 [labelType="html" label="FileScanRDD [47281]<br>count at ColumnStatJob.java:47"]; 47282 [labelType="html" label="MapPartitionsRDD [47282]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110674 { label="WholeStageCodegen (20)"; 47283 [labelType="html" label="MapPartitionsRDD [47283]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110653 { label="Union"; 47284 [labelType="html" label="UnionRDD [47284] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110650 { label="WholeStageCodegen (21)"; 47285 [labelType="html" label="MapPartitionsRDD [47285] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster110649 { label="Exchange"; 47286 [labelType="html" label="MapPartitionsRDD [47286] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 47277->47278; 47278->47279; 47279->47280; 47281->47282; 47282->47283; 47280->47284; 47283->47284; 47284->47285; 47285->47286; }
47258,47277
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time