3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18521 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.5 min
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
83.2 MiB / 2133238
Shuffle Read Size / Records:
10.4 MiB / 262581
Shuffle Write Size / Records:
1180.0 B / 20
Associated Job Ids:
9263
DAG Visualization
digraph G { subgraph clusterstage_18521 { label="Stage 18521"; subgraph cluster120904 { label="Exchange"; 51869 [labelType="html" label="ShuffledRowRDD [51869] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120900 { label="WholeStageCodegen (18)"; 51870 [labelType="html" label="MapPartitionsRDD [51870] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120899 { label="Window"; 51871 [labelType="html" label="MapPartitionsRDD [51871] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120885 { label="WholeStageCodegen (19)"; 51872 [labelType="html" label="MapPartitionsRDD [51872] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120910 { label="Scan parquet "; 51873 [labelType="html" label="FileScanRDD [51873]<br>count at ColumnStatJob.java:47"]; 51874 [labelType="html" label="MapPartitionsRDD [51874]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120905 { label="WholeStageCodegen (20)"; 51875 [labelType="html" label="MapPartitionsRDD [51875]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120884 { label="Union"; 51876 [labelType="html" label="UnionRDD [51876] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120881 { label="WholeStageCodegen (21)"; 51877 [labelType="html" label="MapPartitionsRDD [51877] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster120880 { label="Exchange"; 51878 [labelType="html" label="MapPartitionsRDD [51878] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 51869->51870; 51870->51871; 51871->51872; 51873->51874; 51874->51875; 51872->51876; 51875->51876; 51876->51877; 51877->51878; }
51850,51869
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time