3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8547 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
23 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
98.2 MiB / 2132018
Shuffle Read Size / Records:
11.4 MiB / 262408
Associated Job Ids:
4231
DAG Visualization
digraph G { subgraph clusterstage_8547 { label="Stage 8547"; subgraph cluster56015 { label="Exchange"; 24558 [labelType="html" label="ShuffledRowRDD [24558] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56011 { label="WholeStageCodegen (18)"; 24559 [labelType="html" label="MapPartitionsRDD [24559] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56010 { label="Window"; 24560 [labelType="html" label="MapPartitionsRDD [24560] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56008 { label="Filter"; 24561 [labelType="html" label="MapPartitionsRDD [24561] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56007 { label="Project"; 24562 [labelType="html" label="MapPartitionsRDD [24562] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56006 { label="Project"; 24563 [labelType="html" label="MapPartitionsRDD [24563] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56005 { label="Project"; 24564 [labelType="html" label="MapPartitionsRDD [24564] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56004 { label="Project"; 24565 [labelType="html" label="MapPartitionsRDD [24565] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56003 { label="Project"; 24566 [labelType="html" label="MapPartitionsRDD [24566] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster56021 { label="Scan parquet "; 24567 [labelType="html" label="FileScanRDD [24567]<br>parquet at PersistJob.java:35"]; 24568 [labelType="html" label="MapPartitionsRDD [24568]<br>parquet at PersistJob.java:35"]; } subgraph cluster56016 { label="WholeStageCodegen (20)"; 24569 [labelType="html" label="MapPartitionsRDD [24569]<br>parquet at PersistJob.java:35"]; } subgraph cluster55994 { label="Union"; 24570 [labelType="html" label="UnionRDD [24570] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster55993 { label="Exchange"; 24571 [labelType="html" label="MapPartitionsRDD [24571] [Unordered]<br>parquet at PersistJob.java:35"]; 24572 [labelType="html" label="MapPartitionsRDD [24572] [Unordered]<br>parquet at PersistJob.java:35"]; 24573 [labelType="html" label="MapPartitionsRDD [24573] [Unordered]<br>parquet at PersistJob.java:35"]; } } 24558->24559; 24559->24560; 24560->24561; 24561->24562; 24562->24563; 24563->24564; 24564->24565; 24565->24566; 24567->24568; 24568->24569; 24566->24570; 24569->24570; 24570->24571; 24571->24572; 24572->24573; }
24557,24558
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time