3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5374 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 s
Locality Level Summary:
Any: 10
Input Size / Records:
18.5 MiB / 2199033
Shuffle Read Size / Records:
1840.0 B / 10
Shuffle Write Size / Records:
27.1 KiB / 1733
Associated Job Ids:
2839
DAG Visualization
digraph G { subgraph clusterstage_5374 { label="Stage 5374"; subgraph cluster33420 { label="Scan parquet "; 13747 [labelType="html" label="FileScanRDD [13747]<br>count at ColumnStatJob.java:47"]; 13748 [labelType="html" label="MapPartitionsRDD [13748]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33415 { label="WholeStageCodegen (2)"; 13749 [labelType="html" label="MapPartitionsRDD [13749]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33423 { label="Exchange"; 13750 [labelType="html" label="ShuffledRowRDD [13750] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33421 { label="ObjectHashAggregate"; 13751 [labelType="html" label="MapPartitionsRDD [13751] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33414 { label="CartesianProduct"; 13752 [labelType="html" label="UnsafeCartesianRDD [13752] [Unordered]<br>count at ColumnStatJob.java:47"]; 13753 [labelType="html" label="MapPartitionsRDD [13753] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33411 { label="WholeStageCodegen (3)"; 13754 [labelType="html" label="MapPartitionsRDD [13754] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33428 { label="Scan csv "; 13755 [labelType="html" label="FileScanRDD [13755]<br>count at ColumnStatJob.java:47"]; 13756 [labelType="html" label="MapPartitionsRDD [13756]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33424 { label="WholeStageCodegen (4)"; 13757 [labelType="html" label="MapPartitionsRDD [13757]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33410 { label="CartesianProduct"; 13758 [labelType="html" label="UnsafeCartesianRDD [13758] [Unordered]<br>count at ColumnStatJob.java:47"]; 13759 [labelType="html" label="MapPartitionsRDD [13759] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33407 { label="WholeStageCodegen (5)"; 13760 [labelType="html" label="MapPartitionsRDD [13760] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster33406 { label="Exchange"; 13761 [labelType="html" label="MapPartitionsRDD [13761] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 13747->13748; 13748->13749; 13750->13751; 13749->13752; 13751->13752; 13752->13753; 13753->13754; 13755->13756; 13756->13757; 13754->13758; 13757->13758; 13758->13759; 13759->13760; 13760->13761; }
13746,13750
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time