3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32603 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.4 MiB / 152196
Shuffle Write Size / Records:
1978.3 KiB / 25424
Associated Job Ids:
17962
DAG Visualization
digraph G { subgraph clusterstage_32603 { label="Stage 32603"; subgraph cluster207862 { label="AQEShuffleRead"; 89989 [labelType="html" label="ShuffledRowRDD [89989] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207859 { label="WholeStageCodegen (7)"; 89990 [labelType="html" label="MapPartitionsRDD [89990] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207858 { label="Window"; 89991 [labelType="html" label="MapPartitionsRDD [89991] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207855 { label="WholeStageCodegen (8)"; 89992 [labelType="html" label="MapPartitionsRDD [89992] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207854 { label="Window"; 89994 [labelType="html" label="MapPartitionsRDD [89994] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207851 { label="WholeStageCodegen (9)"; 89995 [labelType="html" label="MapPartitionsRDD [89995] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207887 { label="AQEShuffleRead"; 90003 [labelType="html" label="ShuffledRowRDD [90003] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207873 { label="WholeStageCodegen (10)"; 90005 [labelType="html" label="MapPartitionsRDD [90005] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207846 { label="WholeStageCodegen (11)"; 90007 [labelType="html" label="ZippedPartitionsRDD2 [90007] [Unordered]<br>parquet at PersistJob.java:35"]; 90008 [labelType="html" label="MapPartitionsRDD [90008] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207845 { label="Window"; 90009 [labelType="html" label="MapPartitionsRDD [90009] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207838 { label="WholeStageCodegen (12)"; 90010 [labelType="html" label="MapPartitionsRDD [90010] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207837 { label="Exchange"; 90011 [labelType="html" label="MapPartitionsRDD [90011] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89989->89990; 89990->89991; 89991->89992; 89992->89994; 89994->89995; 90003->90005; 89995->90007; 90005->90007; 90007->90008; 90008->90009; 90009->90010; 90010->90011; }
89977,89989
89943,90003
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time