3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16315 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Shuffle Write Size / Records:
33.4 MiB / 605004
Associated Job Ids:
8512
DAG Visualization
digraph G { subgraph clusterstage_16315 { label="Stage 16315"; subgraph cluster105280 { label="AQEShuffleRead"; 44506 [labelType="html" label="ShuffledRowRDD [44506] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105277 { label="WholeStageCodegen (18)"; 44507 [labelType="html" label="MapPartitionsRDD [44507] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105276 { label="Window"; 44508 [labelType="html" label="MapPartitionsRDD [44508] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105274 { label="Filter"; 44509 [labelType="html" label="MapPartitionsRDD [44509] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105273 { label="Project"; 44510 [labelType="html" label="MapPartitionsRDD [44510] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105272 { label="Project"; 44511 [labelType="html" label="MapPartitionsRDD [44511] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105271 { label="Project"; 44512 [labelType="html" label="MapPartitionsRDD [44512] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105270 { label="Project"; 44513 [labelType="html" label="MapPartitionsRDD [44513] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105269 { label="Project"; 44514 [labelType="html" label="MapPartitionsRDD [44514] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105286 { label="Scan parquet "; 44515 [labelType="html" label="FileScanRDD [44515]<br>rdd at PersistJob.java:28"]; 44516 [labelType="html" label="MapPartitionsRDD [44516]<br>rdd at PersistJob.java:28"]; } subgraph cluster105281 { label="WholeStageCodegen (20)"; 44517 [labelType="html" label="MapPartitionsRDD [44517]<br>rdd at PersistJob.java:28"]; } subgraph cluster105260 { label="Union"; 44518 [labelType="html" label="UnionRDD [44518] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105259 { label="Exchange"; 44522 [labelType="html" label="MapPartitionsRDD [44522] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44506->44507; 44507->44508; 44508->44509; 44509->44510; 44510->44511; 44511->44512; 44512->44513; 44513->44514; 44515->44516; 44516->44517; 44514->44518; 44517->44518; 44518->44522; }
44505,44506
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time