3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9286 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.3 MiB / 133183
Shuffle Read Size / Records:
3.4 KiB / 10
Associated Job Ids:
4748
DAG Visualization
digraph G { subgraph clusterstage_9286 { label="Stage 9286"; subgraph cluster61191 { label="Scan parquet "; 26850 [labelType="html" label="FileScanRDD [26850]<br>parquet at PersistJob.java:35"]; 26851 [labelType="html" label="MapPartitionsRDD [26851]<br>parquet at PersistJob.java:35"]; } subgraph cluster61186 { label="WholeStageCodegen (34)"; 26852 [labelType="html" label="MapPartitionsRDD [26852]<br>parquet at PersistJob.java:35"]; } subgraph cluster61194 { label="Exchange"; 26853 [labelType="html" label="ShuffledRowRDD [26853] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61192 { label="ObjectHashAggregate"; 26854 [labelType="html" label="MapPartitionsRDD [26854] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61185 { label="CartesianProduct"; 26855 [labelType="html" label="UnsafeCartesianRDD [26855] [Unordered]<br>parquet at PersistJob.java:35"]; 26856 [labelType="html" label="MapPartitionsRDD [26856] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61199 { label="Scan csv "; 26857 [labelType="html" label="FileScanRDD [26857]<br>parquet at PersistJob.java:35"]; 26858 [labelType="html" label="MapPartitionsRDD [26858]<br>parquet at PersistJob.java:35"]; } subgraph cluster61195 { label="WholeStageCodegen (35)"; 26859 [labelType="html" label="MapPartitionsRDD [26859]<br>parquet at PersistJob.java:35"]; } subgraph cluster61184 { label="CartesianProduct"; 26860 [labelType="html" label="UnsafeCartesianRDD [26860] [Unordered]<br>parquet at PersistJob.java:35"]; 26861 [labelType="html" label="MapPartitionsRDD [26861] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61180 { label="WholeStageCodegen (36)"; 26862 [labelType="html" label="MapPartitionsRDD [26862] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61179 { label="ObjectHashAggregate"; 26863 [labelType="html" label="MapPartitionsRDD [26863] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61178 { label="Exchange"; 26864 [labelType="html" label="MapPartitionsRDD [26864] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26850->26851; 26851->26852; 26853->26854; 26852->26855; 26854->26855; 26855->26856; 26857->26858; 26858->26859; 26856->26860; 26859->26860; 26860->26861; 26861->26862; 26862->26863; 26863->26864; }
26750,26853
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time