3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16674 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
29 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
157.2 MiB / 2200751
Shuffle Write Size / Records:
172.8 MiB / 2124462
Associated Job Ids:
8117
DAG Visualization
digraph G { subgraph clusterstage_16674 { label="Stage 16674"; subgraph cluster106431 { label="Exchange"; 45405 [labelType="html" label="ShuffledRowRDD [45405] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106427 { label="WholeStageCodegen (3)"; 45406 [labelType="html" label="MapPartitionsRDD [45406] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106442 { label="Exchange"; 45407 [labelType="html" label="ShuffledRowRDD [45407] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106438 { label="WholeStageCodegen (4)"; 45408 [labelType="html" label="MapPartitionsRDD [45408] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106437 { label="Window"; 45409 [labelType="html" label="MapPartitionsRDD [45409] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106433 { label="WholeStageCodegen (5)"; 45410 [labelType="html" label="MapPartitionsRDD [45410] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106423 { label="WholeStageCodegen (6)"; 45411 [labelType="html" label="ZippedPartitionsRDD2 [45411] [Unordered]<br>rdd at PersistJob.java:28"]; 45412 [labelType="html" label="MapPartitionsRDD [45412] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster106422 { label="Exchange"; 45413 [labelType="html" label="MapPartitionsRDD [45413] [Unordered]<br>rdd at PersistJob.java:28"]; } } 45405->45406; 45407->45408; 45408->45409; 45409->45410; 45406->45411; 45410->45411; 45411->45412; 45412->45413; }
45400,45405
45404,45407
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time