3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32579 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.4 MiB / 152196
Shuffle Write Size / Records:
1978.3 KiB / 25424
Associated Job Ids:
17946
DAG Visualization
digraph G { subgraph clusterstage_32579 { label="Stage 32579"; subgraph cluster207569 { label="AQEShuffleRead"; 89853 [labelType="html" label="ShuffledRowRDD [89853] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207566 { label="WholeStageCodegen (7)"; 89858 [labelType="html" label="MapPartitionsRDD [89858] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207565 { label="Window"; 89859 [labelType="html" label="MapPartitionsRDD [89859] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207562 { label="WholeStageCodegen (8)"; 89860 [labelType="html" label="MapPartitionsRDD [89860] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207561 { label="Window"; 89861 [labelType="html" label="MapPartitionsRDD [89861] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207553 { label="WholeStageCodegen (9)"; 89862 [labelType="html" label="MapPartitionsRDD [89862] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207581 { label="AQEShuffleRead"; 89867 [labelType="html" label="ShuffledRowRDD [89867] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207578 { label="WholeStageCodegen (10)"; 89868 [labelType="html" label="MapPartitionsRDD [89868] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207541 { label="WholeStageCodegen (11)"; 89869 [labelType="html" label="ZippedPartitionsRDD2 [89869] [Unordered]<br>rdd at PersistJob.java:28"]; 89870 [labelType="html" label="MapPartitionsRDD [89870] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207540 { label="Window"; 89871 [labelType="html" label="MapPartitionsRDD [89871] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207533 { label="WholeStageCodegen (12)"; 89872 [labelType="html" label="MapPartitionsRDD [89872] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster207532 { label="Exchange"; 89873 [labelType="html" label="MapPartitionsRDD [89873] [Unordered]<br>rdd at PersistJob.java:28"]; } } 89853->89858; 89858->89859; 89859->89860; 89860->89861; 89861->89862; 89867->89868; 89862->89869; 89868->89869; 89869->89870; 89870->89871; 89871->89872; 89872->89873; }
89798,89853
89775,89867
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time