3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17335 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
53 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
23.8 MiB / 596043
Shuffle Read Size / Records:
7.5 MiB / 171879
Shuffle Write Size / Records:
885.0 B / 15
Associated Job Ids:
8694
DAG Visualization
digraph G { subgraph clusterstage_17335 { label="Stage 17335"; subgraph cluster113140 { label="AQEShuffleRead"; 48602 [labelType="html" label="ShuffledRowRDD [48602] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113137 { label="WholeStageCodegen (18)"; 48603 [labelType="html" label="MapPartitionsRDD [48603] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113136 { label="Window"; 48604 [labelType="html" label="MapPartitionsRDD [48604] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113122 { label="WholeStageCodegen (19)"; 48605 [labelType="html" label="MapPartitionsRDD [48605] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113146 { label="Scan parquet "; 48606 [labelType="html" label="FileScanRDD [48606]<br>count at ColumnStatJob.java:47"]; 48607 [labelType="html" label="MapPartitionsRDD [48607]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113141 { label="WholeStageCodegen (20)"; 48608 [labelType="html" label="MapPartitionsRDD [48608]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113121 { label="Union"; 48609 [labelType="html" label="UnionRDD [48609] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113118 { label="WholeStageCodegen (21)"; 48610 [labelType="html" label="MapPartitionsRDD [48610] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster113117 { label="Exchange"; 48611 [labelType="html" label="MapPartitionsRDD [48611] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 48602->48603; 48603->48604; 48604->48605; 48606->48607; 48607->48608; 48605->48609; 48608->48609; 48609->48610; 48610->48611; }
48583,48602
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time