3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14139 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 6
Shuffle Read Size / Records:
6.3 MiB / 413500
Shuffle Write Size / Records:
5.4 MiB / 538288
Associated Job Ids:
6241
DAG Visualization
digraph G { subgraph clusterstage_14139 { label="Stage 14139"; subgraph cluster83311 { label="AQEShuffleRead"; 35294 [labelType="html" label="ShuffledRowRDD [35294] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83308 { label="WholeStageCodegen (4)"; 35295 [labelType="html" label="MapPartitionsRDD [35295] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83307 { label="Window"; 35296 [labelType="html" label="MapPartitionsRDD [35296] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83301 { label="WholeStageCodegen (5)"; 35297 [labelType="html" label="MapPartitionsRDD [35297] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83315 { label="AQEShuffleRead"; 35298 [labelType="html" label="ShuffledRowRDD [35298] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83312 { label="WholeStageCodegen (6)"; 35299 [labelType="html" label="MapPartitionsRDD [35299] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83300 { label="Union"; 35300 [labelType="html" label="UnionRDD [35300] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster83299 { label="Exchange"; 35304 [labelType="html" label="MapPartitionsRDD [35304] [Unordered]<br>rdd at PersistJob.java:28"]; } } 35294->35295; 35295->35296; 35296->35297; 35298->35299; 35297->35300; 35299->35300; 35300->35304; }
35283,35294
35293,35298
Event Timeline
Enable zooming
Tasks: 6. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time