3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7902 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.8 MiB / 415663
Shuffle Write Size / Records:
5.7 MiB / 568241
Associated Job Ids:
3868
DAG Visualization
digraph G { subgraph clusterstage_7902 { label="Stage 7902"; subgraph cluster51643 { label="AQEShuffleRead"; 22818 [labelType="html" label="ShuffledRowRDD [22818] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51640 { label="WholeStageCodegen (4)"; 22819 [labelType="html" label="MapPartitionsRDD [22819] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51639 { label="Window"; 22820 [labelType="html" label="MapPartitionsRDD [22820] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51633 { label="WholeStageCodegen (5)"; 22821 [labelType="html" label="MapPartitionsRDD [22821] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51647 { label="AQEShuffleRead"; 22822 [labelType="html" label="ShuffledRowRDD [22822] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51644 { label="WholeStageCodegen (6)"; 22823 [labelType="html" label="MapPartitionsRDD [22823] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51632 { label="Union"; 22824 [labelType="html" label="UnionRDD [22824] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster51631 { label="Exchange"; 22828 [labelType="html" label="MapPartitionsRDD [22828] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22818->22819; 22819->22820; 22820->22821; 22822->22823; 22821->22824; 22823->22824; 22824->22828; }
22807,22818
22817,22822
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time