3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13573 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
12 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.5 MiB / 2231133
Shuffle Read Size / Records:
2.6 KiB / 10
Shuffle Write Size / Records:
2.5 KiB / 31
Associated Job Ids:
6806
DAG Visualization
digraph G { subgraph clusterstage_13573 { label="Stage 13573"; subgraph cluster88419 { label="Scan parquet "; 37633 [labelType="html" label="FileScanRDD [37633]<br>rdd at PersistJob.java:28"]; 37634 [labelType="html" label="MapPartitionsRDD [37634]<br>rdd at PersistJob.java:28"]; } subgraph cluster88414 { label="WholeStageCodegen (43)"; 37635 [labelType="html" label="MapPartitionsRDD [37635]<br>rdd at PersistJob.java:28"]; } subgraph cluster88422 { label="Exchange"; 37636 [labelType="html" label="ShuffledRowRDD [37636] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88420 { label="ObjectHashAggregate"; 37637 [labelType="html" label="MapPartitionsRDD [37637] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88413 { label="CartesianProduct"; 37638 [labelType="html" label="UnsafeCartesianRDD [37638] [Unordered]<br>rdd at PersistJob.java:28"]; 37639 [labelType="html" label="MapPartitionsRDD [37639] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88427 { label="Scan csv "; 37640 [labelType="html" label="FileScanRDD [37640]<br>rdd at PersistJob.java:28"]; 37641 [labelType="html" label="MapPartitionsRDD [37641]<br>rdd at PersistJob.java:28"]; } subgraph cluster88423 { label="WholeStageCodegen (44)"; 37642 [labelType="html" label="MapPartitionsRDD [37642]<br>rdd at PersistJob.java:28"]; } subgraph cluster88412 { label="CartesianProduct"; 37643 [labelType="html" label="UnsafeCartesianRDD [37643] [Unordered]<br>rdd at PersistJob.java:28"]; 37644 [labelType="html" label="MapPartitionsRDD [37644] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88408 { label="WholeStageCodegen (45)"; 37645 [labelType="html" label="MapPartitionsRDD [37645] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88407 { label="ObjectHashAggregate"; 37646 [labelType="html" label="MapPartitionsRDD [37646] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88406 { label="Exchange"; 37647 [labelType="html" label="MapPartitionsRDD [37647] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37633->37634; 37634->37635; 37636->37637; 37635->37638; 37637->37638; 37638->37639; 37640->37641; 37641->37642; 37639->37643; 37642->37643; 37643->37644; 37644->37645; 37645->37646; 37646->37647; }
37508,37636
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time