3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16280 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 597670
Shuffle Read Size / Records:
8.3 MiB / 173748
Shuffle Write Size / Records:
33.3 MiB / 603650
Associated Job Ids:
7945
DAG Visualization
digraph G { subgraph clusterstage_16280 { label="Stage 16280"; subgraph cluster104344 { label="AQEShuffleRead"; 44562 [labelType="html" label="ShuffledRowRDD [44562] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104341 { label="WholeStageCodegen (18)"; 44563 [labelType="html" label="MapPartitionsRDD [44563] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104340 { label="Window"; 44564 [labelType="html" label="MapPartitionsRDD [44564] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104338 { label="Filter"; 44565 [labelType="html" label="MapPartitionsRDD [44565] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104337 { label="Project"; 44566 [labelType="html" label="MapPartitionsRDD [44566] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104336 { label="Project"; 44567 [labelType="html" label="MapPartitionsRDD [44567] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104335 { label="Project"; 44568 [labelType="html" label="MapPartitionsRDD [44568] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104334 { label="Project"; 44569 [labelType="html" label="MapPartitionsRDD [44569] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104333 { label="Project"; 44570 [labelType="html" label="MapPartitionsRDD [44570] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104350 { label="Scan parquet "; 44571 [labelType="html" label="FileScanRDD [44571]<br>parquet at PersistJob.java:35"]; 44572 [labelType="html" label="MapPartitionsRDD [44572]<br>parquet at PersistJob.java:35"]; } subgraph cluster104345 { label="WholeStageCodegen (20)"; 44573 [labelType="html" label="MapPartitionsRDD [44573]<br>parquet at PersistJob.java:35"]; } subgraph cluster104324 { label="Union"; 44574 [labelType="html" label="UnionRDD [44574] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster104323 { label="Exchange"; 44578 [labelType="html" label="MapPartitionsRDD [44578] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44562->44563; 44563->44564; 44564->44565; 44565->44566; 44566->44567; 44567->44568; 44568->44569; 44569->44570; 44571->44572; 44572->44573; 44570->44574; 44573->44574; 44574->44578; }
44561,44562
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time