3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9282 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 10
Input Size / Records:
3.8 MiB / 133183
Shuffle Read Size / Records:
2020.0 B / 10
Shuffle Write Size / Records:
190.0 B / 1
Associated Job Ids:
4746
DAG Visualization
digraph G { subgraph clusterstage_9282 { label="Stage 9282"; subgraph cluster61147 { label="Scan parquet "; 26820 [labelType="html" label="FileScanRDD [26820]<br>parquet at PersistJob.java:35"]; 26821 [labelType="html" label="MapPartitionsRDD [26821]<br>parquet at PersistJob.java:35"]; } subgraph cluster61142 { label="WholeStageCodegen (28)"; 26822 [labelType="html" label="MapPartitionsRDD [26822]<br>parquet at PersistJob.java:35"]; } subgraph cluster61150 { label="Exchange"; 26823 [labelType="html" label="ShuffledRowRDD [26823] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61148 { label="ObjectHashAggregate"; 26824 [labelType="html" label="MapPartitionsRDD [26824] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61141 { label="CartesianProduct"; 26825 [labelType="html" label="UnsafeCartesianRDD [26825] [Unordered]<br>parquet at PersistJob.java:35"]; 26826 [labelType="html" label="MapPartitionsRDD [26826] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61155 { label="Scan csv "; 26827 [labelType="html" label="FileScanRDD [26827]<br>parquet at PersistJob.java:35"]; 26828 [labelType="html" label="MapPartitionsRDD [26828]<br>parquet at PersistJob.java:35"]; } subgraph cluster61151 { label="WholeStageCodegen (29)"; 26829 [labelType="html" label="MapPartitionsRDD [26829]<br>parquet at PersistJob.java:35"]; } subgraph cluster61140 { label="CartesianProduct"; 26830 [labelType="html" label="UnsafeCartesianRDD [26830] [Unordered]<br>parquet at PersistJob.java:35"]; 26831 [labelType="html" label="MapPartitionsRDD [26831] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61136 { label="WholeStageCodegen (30)"; 26832 [labelType="html" label="MapPartitionsRDD [26832] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61135 { label="ObjectHashAggregate"; 26833 [labelType="html" label="MapPartitionsRDD [26833] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61134 { label="Exchange"; 26834 [labelType="html" label="MapPartitionsRDD [26834] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26820->26821; 26821->26822; 26823->26824; 26822->26825; 26824->26825; 26825->26826; 26827->26828; 26828->26829; 26826->26830; 26829->26830; 26830->26831; 26831->26832; 26832->26833; 26833->26834; }
26740,26823
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time