3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18370 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.6 min
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
83.2 MiB / 2133238
Shuffle Read Size / Records:
10.4 MiB / 262581
Shuffle Write Size / Records:
1180.0 B / 20
Associated Job Ids:
9200
DAG Visualization
digraph G { subgraph clusterstage_18370 { label="Stage 18370"; subgraph cluster119821 { label="Exchange"; 51456 [labelType="html" label="ShuffledRowRDD [51456] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119817 { label="WholeStageCodegen (18)"; 51457 [labelType="html" label="MapPartitionsRDD [51457] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119816 { label="Window"; 51458 [labelType="html" label="MapPartitionsRDD [51458] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119746 { label="WholeStageCodegen (19)"; 51459 [labelType="html" label="MapPartitionsRDD [51459] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119827 { label="Scan parquet "; 51460 [labelType="html" label="FileScanRDD [51460]<br>count at ColumnStatJob.java:47"]; 51461 [labelType="html" label="MapPartitionsRDD [51461]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119822 { label="WholeStageCodegen (20)"; 51462 [labelType="html" label="MapPartitionsRDD [51462]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119745 { label="Union"; 51463 [labelType="html" label="UnionRDD [51463] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119742 { label="WholeStageCodegen (21)"; 51464 [labelType="html" label="MapPartitionsRDD [51464] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119741 { label="Exchange"; 51465 [labelType="html" label="MapPartitionsRDD [51465] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 51456->51457; 51457->51458; 51458->51459; 51460->51461; 51461->51462; 51459->51463; 51462->51463; 51463->51464; 51464->51465; }
51420,51456
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time