3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9217 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.2 MiB / 133183
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
4722
DAG Visualization
digraph G { subgraph clusterstage_9217 { label="Stage 9217"; subgraph cluster60762 { label="Scan parquet "; 26601 [labelType="html" label="FileScanRDD [26601]<br>rdd at PersistJob.java:28"]; 26602 [labelType="html" label="MapPartitionsRDD [26602]<br>rdd at PersistJob.java:28"]; } subgraph cluster60757 { label="WholeStageCodegen (40)"; 26603 [labelType="html" label="MapPartitionsRDD [26603]<br>rdd at PersistJob.java:28"]; } subgraph cluster60765 { label="Exchange"; 26604 [labelType="html" label="ShuffledRowRDD [26604] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60763 { label="ObjectHashAggregate"; 26605 [labelType="html" label="MapPartitionsRDD [26605] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60756 { label="CartesianProduct"; 26606 [labelType="html" label="UnsafeCartesianRDD [26606] [Unordered]<br>rdd at PersistJob.java:28"]; 26607 [labelType="html" label="MapPartitionsRDD [26607] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60770 { label="Scan csv "; 26608 [labelType="html" label="FileScanRDD [26608]<br>rdd at PersistJob.java:28"]; 26609 [labelType="html" label="MapPartitionsRDD [26609]<br>rdd at PersistJob.java:28"]; } subgraph cluster60766 { label="WholeStageCodegen (41)"; 26610 [labelType="html" label="MapPartitionsRDD [26610]<br>rdd at PersistJob.java:28"]; } subgraph cluster60755 { label="CartesianProduct"; 26611 [labelType="html" label="UnsafeCartesianRDD [26611] [Unordered]<br>rdd at PersistJob.java:28"]; 26612 [labelType="html" label="MapPartitionsRDD [26612] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60751 { label="WholeStageCodegen (42)"; 26613 [labelType="html" label="MapPartitionsRDD [26613] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60750 { label="ObjectHashAggregate"; 26614 [labelType="html" label="MapPartitionsRDD [26614] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60749 { label="Exchange"; 26615 [labelType="html" label="MapPartitionsRDD [26615] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26601->26602; 26602->26603; 26604->26605; 26603->26606; 26605->26606; 26606->26607; 26608->26609; 26609->26610; 26607->26611; 26610->26611; 26611->26612; 26612->26613; 26613->26614; 26614->26615; }
26481,26604
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time