3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 9290 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 10
Input Size / Records:
2.2 MiB / 133183
Shuffle Read Size / Records:
1480.0 B / 10
Associated Job Ids:
4750
DAG Visualization
digraph G { subgraph clusterstage_9290 { label="Stage 9290"; subgraph cluster61235 { label="Scan parquet "; 26880 [labelType="html" label="FileScanRDD [26880]<br>parquet at PersistJob.java:35"]; 26881 [labelType="html" label="MapPartitionsRDD [26881]<br>parquet at PersistJob.java:35"]; } subgraph cluster61230 { label="WholeStageCodegen (40)"; 26882 [labelType="html" label="MapPartitionsRDD [26882]<br>parquet at PersistJob.java:35"]; } subgraph cluster61238 { label="Exchange"; 26883 [labelType="html" label="ShuffledRowRDD [26883] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61236 { label="ObjectHashAggregate"; 26884 [labelType="html" label="MapPartitionsRDD [26884] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61229 { label="CartesianProduct"; 26885 [labelType="html" label="UnsafeCartesianRDD [26885] [Unordered]<br>parquet at PersistJob.java:35"]; 26886 [labelType="html" label="MapPartitionsRDD [26886] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61243 { label="Scan csv "; 26887 [labelType="html" label="FileScanRDD [26887]<br>parquet at PersistJob.java:35"]; 26888 [labelType="html" label="MapPartitionsRDD [26888]<br>parquet at PersistJob.java:35"]; } subgraph cluster61239 { label="WholeStageCodegen (41)"; 26889 [labelType="html" label="MapPartitionsRDD [26889]<br>parquet at PersistJob.java:35"]; } subgraph cluster61228 { label="CartesianProduct"; 26890 [labelType="html" label="UnsafeCartesianRDD [26890] [Unordered]<br>parquet at PersistJob.java:35"]; 26891 [labelType="html" label="MapPartitionsRDD [26891] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61224 { label="WholeStageCodegen (42)"; 26892 [labelType="html" label="MapPartitionsRDD [26892] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61223 { label="ObjectHashAggregate"; 26893 [labelType="html" label="MapPartitionsRDD [26893] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster61222 { label="Exchange"; 26894 [labelType="html" label="MapPartitionsRDD [26894] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26880->26881; 26881->26882; 26883->26884; 26882->26885; 26884->26885; 26885->26886; 26887->26888; 26888->26889; 26886->26890; 26889->26890; 26890->26891; 26891->26892; 26892->26893; 26893->26894; }
26760,26883
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time