3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16540 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
47 s
Locality Level Summary:
Any: 9
Shuffle Read Size / Records:
89.4 MiB / 1116233
Shuffle Write Size / Records:
65.7 MiB / 1115956
Associated Job Ids:
8091
DAG Visualization
digraph G { subgraph clusterstage_16540 { label="Stage 16540"; subgraph cluster105884 { label="AQEShuffleRead"; 45203 [labelType="html" label="ShuffledRowRDD [45203] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105881 { label="WholeStageCodegen (35)"; 45204 [labelType="html" label="MapPartitionsRDD [45204] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105889 { label="AQEShuffleRead"; 45205 [labelType="html" label="ShuffledRowRDD [45205] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105886 { label="WholeStageCodegen (36)"; 45206 [labelType="html" label="MapPartitionsRDD [45206] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105877 { label="WholeStageCodegen (37)"; 45207 [labelType="html" label="ZippedPartitionsRDD2 [45207] [Unordered]<br>rdd at PersistJob.java:28"]; 45208 [labelType="html" label="MapPartitionsRDD [45208] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105894 { label="AQEShuffleRead"; 45209 [labelType="html" label="ShuffledRowRDD [45209] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105891 { label="WholeStageCodegen (38)"; 45210 [labelType="html" label="MapPartitionsRDD [45210] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105873 { label="WholeStageCodegen (39)"; 45211 [labelType="html" label="ZippedPartitionsRDD2 [45211] [Unordered]<br>rdd at PersistJob.java:28"]; 45212 [labelType="html" label="MapPartitionsRDD [45212] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105899 { label="AQEShuffleRead"; 45213 [labelType="html" label="ShuffledRowRDD [45213] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105896 { label="WholeStageCodegen (40)"; 45214 [labelType="html" label="MapPartitionsRDD [45214] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105869 { label="WholeStageCodegen (41)"; 45215 [labelType="html" label="ZippedPartitionsRDD2 [45215] [Unordered]<br>rdd at PersistJob.java:28"]; 45216 [labelType="html" label="MapPartitionsRDD [45216] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster105868 { label="Exchange"; 45217 [labelType="html" label="MapPartitionsRDD [45217] [Unordered]<br>rdd at PersistJob.java:28"]; } } 45203->45204; 45205->45206; 45204->45207; 45206->45207; 45207->45208; 45209->45210; 45208->45211; 45210->45211; 45211->45212; 45213->45214; 45212->45215; 45214->45215; 45215->45216; 45216->45217; }
45202,45203
45132,45205
45136,45209
45140,45213
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time