3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 32218 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
9 s
Locality Level Summary:
Any: 7
Shuffle Read Size / Records:
18.1 MiB / 592158
Shuffle Write Size / Records:
16.5 MiB / 591883
Associated Job Ids:
17829
DAG Visualization
digraph G { subgraph clusterstage_32218 { label="Stage 32218"; subgraph cluster205610 { label="AQEShuffleRead"; 89002 [labelType="html" label="ShuffledRowRDD [89002] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205607 { label="WholeStageCodegen (38)"; 89003 [labelType="html" label="MapPartitionsRDD [89003] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205615 { label="AQEShuffleRead"; 89004 [labelType="html" label="ShuffledRowRDD [89004] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205612 { label="WholeStageCodegen (39)"; 89005 [labelType="html" label="MapPartitionsRDD [89005] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205603 { label="WholeStageCodegen (40)"; 89006 [labelType="html" label="ZippedPartitionsRDD2 [89006] [Unordered]<br>rdd at PersistJob.java:28"]; 89007 [labelType="html" label="MapPartitionsRDD [89007] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205620 { label="AQEShuffleRead"; 89008 [labelType="html" label="ShuffledRowRDD [89008] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205617 { label="WholeStageCodegen (41)"; 89009 [labelType="html" label="MapPartitionsRDD [89009] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205597 { label="WholeStageCodegen (42)"; 89010 [labelType="html" label="ZippedPartitionsRDD2 [89010] [Unordered]<br>rdd at PersistJob.java:28"]; 89011 [labelType="html" label="MapPartitionsRDD [89011] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster205596 { label="Exchange"; 89012 [labelType="html" label="MapPartitionsRDD [89012] [Unordered]<br>rdd at PersistJob.java:28"]; } } 89002->89003; 89004->89005; 89003->89006; 89005->89006; 89006->89007; 89008->89009; 89007->89010; 89009->89010; 89010->89011; 89011->89012; }
89001,89002
88908,89004
88912,89008
Event Timeline
Enable zooming
Tasks: 7. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time