3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32608 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 3
Output Size / Records:
198.2 KiB / 10838
Shuffle Read Size / Records:
4.0 MiB / 223581
Associated Job Ids:
17963
DAG Visualization
digraph G { subgraph clusterstage_32608 { label="Stage 32608"; subgraph cluster207871 { label="AQEShuffleRead"; 89993 [labelType="html" label="ShuffledRowRDD [89993] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207868 { label="WholeStageCodegen (8)"; 89996 [labelType="html" label="MapPartitionsRDD [89996] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207880 { label="AQEShuffleRead"; 89997 [labelType="html" label="ShuffledRowRDD [89997] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207877 { label="WholeStageCodegen (9)"; 89998 [labelType="html" label="MapPartitionsRDD [89998] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207864 { label="WholeStageCodegen (10)"; 89999 [labelType="html" label="ZippedPartitionsRDD2 [89999] [Unordered]<br>parquet at PersistJob.java:35"]; 90000 [labelType="html" label="MapPartitionsRDD [90000] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207886 { label="AQEShuffleRead"; 90001 [labelType="html" label="ShuffledRowRDD [90001] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207885 { label="ObjectHashAggregate"; 90002 [labelType="html" label="MapPartitionsRDD [90002] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207882 { label="WholeStageCodegen (11)"; 90004 [labelType="html" label="MapPartitionsRDD [90004] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207832 { label="WholeStageCodegen (12)"; 90006 [labelType="html" label="ZippedPartitionsRDD2 [90006] [Unordered]<br>parquet at PersistJob.java:35"]; 90012 [labelType="html" label="MapPartitionsRDD [90012] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster207831 { label="WriteFiles"; 90013 [labelType="html" label="MapPartitionsRDD [90013] [Unordered]<br>parquet at PersistJob.java:35"]; } } 89993->89996; 89997->89998; 89996->89999; 89998->89999; 89999->90000; 90001->90002; 90002->90004; 90000->90006; 90004->90006; 90006->90012; 90012->90013; }
89988,89993
89965,89997
89970,90001
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time