3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9215 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.2 MiB / 133173
Shuffle Read Size / Records:
2.7 KiB / 10
Associated Job Ids:
4721
DAG Visualization
digraph G { subgraph clusterstage_9215 { label="Stage 9215"; subgraph cluster60740 { label="Scan parquet "; 26586 [labelType="html" label="FileScanRDD [26586]<br>rdd at PersistJob.java:28"]; 26587 [labelType="html" label="MapPartitionsRDD [26587]<br>rdd at PersistJob.java:28"]; } subgraph cluster60735 { label="WholeStageCodegen (37)"; 26588 [labelType="html" label="MapPartitionsRDD [26588]<br>rdd at PersistJob.java:28"]; } subgraph cluster60743 { label="Exchange"; 26589 [labelType="html" label="ShuffledRowRDD [26589] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60741 { label="ObjectHashAggregate"; 26590 [labelType="html" label="MapPartitionsRDD [26590] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60734 { label="CartesianProduct"; 26591 [labelType="html" label="UnsafeCartesianRDD [26591] [Unordered]<br>rdd at PersistJob.java:28"]; 26592 [labelType="html" label="MapPartitionsRDD [26592] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60748 { label="Scan csv "; 26593 [labelType="html" label="FileScanRDD [26593]<br>rdd at PersistJob.java:28"]; 26594 [labelType="html" label="MapPartitionsRDD [26594]<br>rdd at PersistJob.java:28"]; } subgraph cluster60744 { label="WholeStageCodegen (38)"; 26595 [labelType="html" label="MapPartitionsRDD [26595]<br>rdd at PersistJob.java:28"]; } subgraph cluster60733 { label="CartesianProduct"; 26596 [labelType="html" label="UnsafeCartesianRDD [26596] [Unordered]<br>rdd at PersistJob.java:28"]; 26597 [labelType="html" label="MapPartitionsRDD [26597] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60729 { label="WholeStageCodegen (39)"; 26598 [labelType="html" label="MapPartitionsRDD [26598] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60728 { label="ObjectHashAggregate"; 26599 [labelType="html" label="MapPartitionsRDD [26599] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster60727 { label="Exchange"; 26600 [labelType="html" label="MapPartitionsRDD [26600] [Unordered]<br>rdd at PersistJob.java:28"]; } } 26586->26587; 26587->26588; 26589->26590; 26588->26591; 26590->26591; 26591->26592; 26593->26594; 26594->26595; 26592->26596; 26595->26596; 26596->26597; 26597->26598; 26598->26599; 26599->26600; }
26476,26589
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time