3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9209 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 10
Input Size / Records:
3.8 MiB / 133183
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
190.0 B / 1
Associated Job Ids:
4718
DAG Visualization
digraph G { subgraph clusterstage_9209 { label="Stage 9209"; subgraph cluster60674 { label="Scan parquet "; 26541 [labelType="html" label="FileScanRDD [26541]<br>rdd at PersistJob.java:28"]; 26542 [labelType="html" label="MapPartitionsRDD [26542]<br>rdd at PersistJob.java:28"]; } subgraph cluster60669 { label="WholeStageCodegen (28)"; 26543 [labelType="html" label="MapPartitionsRDD [26543]<br>rdd at PersistJob.java:28"]; } subgraph cluster60677 { label="Exchange"; 26544 [labelType="html" label="ShuffledRowRDD [26544] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60675 { label="ObjectHashAggregate"; 26545 [labelType="html" label="MapPartitionsRDD [26545] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60668 { label="CartesianProduct"; 26546 [labelType="html" label="UnsafeCartesianRDD [26546] [Unordered]<br>rdd at PersistJob.java:28"]; 26547 [labelType="html" label="MapPartitionsRDD [26547] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60682 { label="Scan csv "; 26548 [labelType="html" label="FileScanRDD [26548]<br>rdd at PersistJob.java:28"]; 26549 [labelType="html" label="MapPartitionsRDD [26549]<br>rdd at PersistJob.java:28"]; } subgraph cluster60678 { label="WholeStageCodegen (29)"; 26550 [labelType="html" label="MapPartitionsRDD [26550]<br>rdd at PersistJob.java:28"]; } subgraph cluster60667 { label="CartesianProduct"; 26551 [labelType="html" label="UnsafeCartesianRDD [26551] [Unordered]<br>rdd at PersistJob.java:28"]; 26552 [labelType="html" label="MapPartitionsRDD [26552] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60663 { label="WholeStageCodegen (30)"; 26553 [labelType="html" label="MapPartitionsRDD [26553] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60662 { label="ObjectHashAggregate"; 26554 [labelType="html" label="MapPartitionsRDD [26554] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60661 { label="Exchange"; 26555 [labelType="html" label="MapPartitionsRDD [26555] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26541->26542; 26542->26543; 26544->26545; 26543->26546; 26545->26546; 26546->26547; 26548->26549; 26549->26550; 26547->26551; 26550->26551; 26551->26552; 26552->26553; 26553->26554; 26554->26555; }
26461,26544
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time