3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7823 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 5
Output Size / Records:
52.8 KiB / 539
Shuffle Read Size / Records:
5.0 MiB / 123388
Associated Job Ids:
3816
DAG Visualization
digraph G { subgraph clusterstage_7823 { label="Stage 7823"; subgraph cluster50840 { label="AQEShuffleRead"; 22488 [labelType="html" label="ShuffledRowRDD [22488] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50837 { label="WholeStageCodegen (12)"; 22489 [labelType="html" label="MapPartitionsRDD [22489] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50846 { label="AQEShuffleRead"; 22490 [labelType="html" label="ShuffledRowRDD [22490] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50845 { label="ObjectHashAggregate"; 22491 [labelType="html" label="MapPartitionsRDD [22491] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50842 { label="WholeStageCodegen (13)"; 22492 [labelType="html" label="MapPartitionsRDD [22492] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50830 { label="WholeStageCodegen (14)"; 22493 [labelType="html" label="ZippedPartitionsRDD2 [22493] [Unordered]<br>parquet at PersistJob.java:35"]; 22494 [labelType="html" label="MapPartitionsRDD [22494] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster50829 { label="WriteFiles"; 22495 [labelType="html" label="MapPartitionsRDD [22495] [Unordered]<br>parquet at PersistJob.java:35"]; } } 22488->22489; 22490->22491; 22491->22492; 22489->22493; 22492->22493; 22493->22494; 22494->22495; }
22463,22488
22487,22490
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time