3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16283 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Shuffle Write Size / Records:
33.4 MiB / 605004
Associated Job Ids:
8503
DAG Visualization
digraph G { subgraph clusterstage_16283 { label="Stage 16283"; subgraph cluster105072 { label="AQEShuffleRead"; 44431 [labelType="html" label="ShuffledRowRDD [44431] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105069 { label="WholeStageCodegen (18)"; 44432 [labelType="html" label="MapPartitionsRDD [44432] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105068 { label="Window"; 44433 [labelType="html" label="MapPartitionsRDD [44433] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105066 { label="Filter"; 44434 [labelType="html" label="MapPartitionsRDD [44434] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105065 { label="Project"; 44435 [labelType="html" label="MapPartitionsRDD [44435] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105064 { label="Project"; 44436 [labelType="html" label="MapPartitionsRDD [44436] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105063 { label="Project"; 44437 [labelType="html" label="MapPartitionsRDD [44437] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105062 { label="Project"; 44438 [labelType="html" label="MapPartitionsRDD [44438] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105061 { label="Project"; 44439 [labelType="html" label="MapPartitionsRDD [44439] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105078 { label="Scan parquet "; 44440 [labelType="html" label="FileScanRDD [44440]<br>rdd at PersistJob.java:21"]; 44441 [labelType="html" label="MapPartitionsRDD [44441]<br>rdd at PersistJob.java:21"]; } subgraph cluster105073 { label="WholeStageCodegen (20)"; 44442 [labelType="html" label="MapPartitionsRDD [44442]<br>rdd at PersistJob.java:21"]; } subgraph cluster105052 { label="Union"; 44443 [labelType="html" label="UnionRDD [44443] [Unordered]<br>rdd at PersistJob.java:21"]; } subgraph cluster105051 { label="Exchange"; 44447 [labelType="html" label="MapPartitionsRDD [44447] [Unordered]<br>rdd at PersistJob.java:21"]; } } 44431->44432; 44432->44433; 44433->44434; 44434->44435; 44435->44436; 44436->44437; 44437->44438; 44438->44439; 44440->44441; 44441->44442; 44439->44443; 44442->44443; 44443->44447; }
44430,44431
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time