3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7631 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
15.1 MiB / 259486
Associated Job Ids:
3712
DAG Visualization
digraph G { subgraph clusterstage_7631 { label="Stage 7631"; subgraph cluster49302 { label="AQEShuffleRead"; 21737 [labelType="html" label="ShuffledRowRDD [21737] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49299 { label="WholeStageCodegen (3)"; 21738 [labelType="html" label="MapPartitionsRDD [21738] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49307 { label="AQEShuffleRead"; 21739 [labelType="html" label="ShuffledRowRDD [21739] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49304 { label="WholeStageCodegen (4)"; 21740 [labelType="html" label="MapPartitionsRDD [21740] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49295 { label="WholeStageCodegen (5)"; 21741 [labelType="html" label="ZippedPartitionsRDD2 [21741] [Unordered]<br>parquet at PersistJob.java:35"]; 21742 [labelType="html" label="MapPartitionsRDD [21742] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49294 { label="Exchange"; 21743 [labelType="html" label="MapPartitionsRDD [21743] [Unordered]<br>parquet at PersistJob.java:35"]; 21744 [labelType="html" label="MapPartitionsRDD [21744] [Unordered]<br>parquet at PersistJob.java:35"]; 21745 [labelType="html" label="MapPartitionsRDD [21745] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21737->21738; 21739->21740; 21738->21741; 21740->21741; 21741->21742; 21742->21743; 21743->21744; 21744->21745; }
21732,21737
21736,21739
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time