3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16077 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
605.6 KiB / 47098
Shuffle Write Size / Records:
794.8 KiB / 43029
Associated Job Ids:
7853
DAG Visualization
digraph G { subgraph clusterstage_16077 { label="Stage 16077"; subgraph cluster102767 { label="AQEShuffleRead"; 43923 [labelType="html" label="ShuffledRowRDD [43923] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102764 { label="WholeStageCodegen (7)"; 43924 [labelType="html" label="MapPartitionsRDD [43924] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102772 { label="AQEShuffleRead"; 43925 [labelType="html" label="ShuffledRowRDD [43925] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102769 { label="WholeStageCodegen (8)"; 43926 [labelType="html" label="MapPartitionsRDD [43926] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102760 { label="WholeStageCodegen (9)"; 43927 [labelType="html" label="ZippedPartitionsRDD2 [43927] [Unordered]<br>parquet at PersistJob.java:35"]; 43928 [labelType="html" label="MapPartitionsRDD [43928] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102777 { label="AQEShuffleRead"; 43929 [labelType="html" label="ShuffledRowRDD [43929] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102774 { label="WholeStageCodegen (10)"; 43930 [labelType="html" label="MapPartitionsRDD [43930] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102756 { label="WholeStageCodegen (11)"; 43931 [labelType="html" label="ZippedPartitionsRDD2 [43931] [Unordered]<br>parquet at PersistJob.java:35"]; 43932 [labelType="html" label="MapPartitionsRDD [43932] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102755 { label="ObjectHashAggregate"; 43933 [labelType="html" label="MapPartitionsRDD [43933] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102754 { label="Exchange"; 43934 [labelType="html" label="MapPartitionsRDD [43934] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43923->43924; 43925->43926; 43924->43927; 43926->43927; 43927->43928; 43929->43930; 43928->43931; 43930->43931; 43931->43932; 43932->43933; 43933->43934; }
43901,43923
43905,43925
43909,43929
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time