3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8319 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
1556.8 KiB / 110715
Associated Job Ids:
4115
DAG Visualization
digraph G { subgraph clusterstage_8319 { label="Stage 8319"; subgraph cluster54599 { label="AQEShuffleRead"; 23989 [labelType="html" label="ShuffledRowRDD [23989] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54596 { label="WholeStageCodegen (4)"; 23990 [labelType="html" label="MapPartitionsRDD [23990] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54595 { label="Window"; 23991 [labelType="html" label="MapPartitionsRDD [23991] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54589 { label="WholeStageCodegen (5)"; 23992 [labelType="html" label="MapPartitionsRDD [23992] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54603 { label="AQEShuffleRead"; 23993 [labelType="html" label="ShuffledRowRDD [23993] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54600 { label="WholeStageCodegen (6)"; 23994 [labelType="html" label="MapPartitionsRDD [23994] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54588 { label="Union"; 23995 [labelType="html" label="UnionRDD [23995] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster54587 { label="Exchange"; 23996 [labelType="html" label="MapPartitionsRDD [23996] [Unordered]<br>rdd at PersistJob.java:28"]; 23997 [labelType="html" label="MapPartitionsRDD [23997] [Unordered]<br>rdd at PersistJob.java:28"]; 23998 [labelType="html" label="MapPartitionsRDD [23998] [Unordered]<br>rdd at PersistJob.java:28"]; } } 23989->23990; 23990->23991; 23991->23992; 23993->23994; 23992->23995; 23994->23995; 23995->23996; 23996->23997; 23997->23998; }
23978,23989
23988,23993
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time