3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18250 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
27 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
98.2 MiB / 2133238
Shuffle Read Size / Records:
11.4 MiB / 262581
Associated Job Ids:
9136
DAG Visualization
digraph G { subgraph clusterstage_18250 { label="Stage 18250"; subgraph cluster119096 { label="Exchange"; 51165 [labelType="html" label="ShuffledRowRDD [51165] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119092 { label="WholeStageCodegen (18)"; 51166 [labelType="html" label="MapPartitionsRDD [51166] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119091 { label="Window"; 51167 [labelType="html" label="MapPartitionsRDD [51167] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119089 { label="Filter"; 51168 [labelType="html" label="MapPartitionsRDD [51168] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119088 { label="Project"; 51169 [labelType="html" label="MapPartitionsRDD [51169] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119087 { label="Project"; 51170 [labelType="html" label="MapPartitionsRDD [51170] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119086 { label="Project"; 51171 [labelType="html" label="MapPartitionsRDD [51171] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119085 { label="Project"; 51172 [labelType="html" label="MapPartitionsRDD [51172] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119084 { label="Project"; 51173 [labelType="html" label="MapPartitionsRDD [51173] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119102 { label="Scan parquet "; 51174 [labelType="html" label="FileScanRDD [51174]<br>parquet at PersistJob.java:35"]; 51175 [labelType="html" label="MapPartitionsRDD [51175]<br>parquet at PersistJob.java:35"]; } subgraph cluster119097 { label="WholeStageCodegen (20)"; 51176 [labelType="html" label="MapPartitionsRDD [51176]<br>parquet at PersistJob.java:35"]; } subgraph cluster119062 { label="Union"; 51177 [labelType="html" label="UnionRDD [51177] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster119061 { label="Exchange"; 51178 [labelType="html" label="MapPartitionsRDD [51178] [Unordered]<br>parquet at PersistJob.java:35"]; 51179 [labelType="html" label="MapPartitionsRDD [51179] [Unordered]<br>parquet at PersistJob.java:35"]; 51180 [labelType="html" label="MapPartitionsRDD [51180] [Unordered]<br>parquet at PersistJob.java:35"]; } } 51165->51166; 51166->51167; 51167->51168; 51168->51169; 51169->51170; 51170->51171; 51171->51172; 51172->51173; 51174->51175; 51175->51176; 51173->51177; 51176->51177; 51177->51178; 51178->51179; 51179->51180; }
51146,51165
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time