3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9207 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.3 MiB / 133183
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
190.0 B / 1
Associated Job Ids:
4717
DAG Visualization
digraph G { subgraph clusterstage_9207 { label="Stage 9207"; subgraph cluster60652 { label="Scan parquet "; 26526 [labelType="html" label="FileScanRDD [26526]<br>rdd at PersistJob.java:28"]; 26527 [labelType="html" label="MapPartitionsRDD [26527]<br>rdd at PersistJob.java:28"]; } subgraph cluster60647 { label="WholeStageCodegen (25)"; 26528 [labelType="html" label="MapPartitionsRDD [26528]<br>rdd at PersistJob.java:28"]; } subgraph cluster60655 { label="Exchange"; 26529 [labelType="html" label="ShuffledRowRDD [26529] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60653 { label="ObjectHashAggregate"; 26530 [labelType="html" label="MapPartitionsRDD [26530] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60646 { label="CartesianProduct"; 26531 [labelType="html" label="UnsafeCartesianRDD [26531] [Unordered]<br>rdd at PersistJob.java:28"]; 26532 [labelType="html" label="MapPartitionsRDD [26532] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60660 { label="Scan csv "; 26533 [labelType="html" label="FileScanRDD [26533]<br>rdd at PersistJob.java:28"]; 26534 [labelType="html" label="MapPartitionsRDD [26534]<br>rdd at PersistJob.java:28"]; } subgraph cluster60656 { label="WholeStageCodegen (26)"; 26535 [labelType="html" label="MapPartitionsRDD [26535]<br>rdd at PersistJob.java:28"]; } subgraph cluster60645 { label="CartesianProduct"; 26536 [labelType="html" label="UnsafeCartesianRDD [26536] [Unordered]<br>rdd at PersistJob.java:28"]; 26537 [labelType="html" label="MapPartitionsRDD [26537] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60641 { label="WholeStageCodegen (27)"; 26538 [labelType="html" label="MapPartitionsRDD [26538] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60640 { label="ObjectHashAggregate"; 26539 [labelType="html" label="MapPartitionsRDD [26539] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60639 { label="Exchange"; 26540 [labelType="html" label="MapPartitionsRDD [26540] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26526->26527; 26527->26528; 26529->26530; 26528->26531; 26530->26531; 26531->26532; 26533->26534; 26534->26535; 26532->26536; 26535->26536; 26536->26537; 26537->26538; 26538->26539; 26539->26540; }
26445,26529
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time