3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16126 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1.0 s
Locality Level Summary:
Any: 5
Input Size / Records:
997.5 KiB / 74864
Shuffle Read Size / Records:
2.3 KiB / 5
Shuffle Write Size / Records:
2.9 KiB / 41
Associated Job Ids:
8134
DAG Visualization
digraph G { subgraph clusterstage_16126 { label="Stage 16126"; subgraph cluster105459 { label="Scan parquet "; 45309 [labelType="html" label="FileScanRDD [45309]<br>parquet at PersistJob.java:35"]; 45310 [labelType="html" label="MapPartitionsRDD [45310]<br>parquet at PersistJob.java:35"]; } subgraph cluster105454 { label="WholeStageCodegen (25)"; 45311 [labelType="html" label="MapPartitionsRDD [45311]<br>parquet at PersistJob.java:35"]; } subgraph cluster105462 { label="Exchange"; 45312 [labelType="html" label="ShuffledRowRDD [45312] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105460 { label="ObjectHashAggregate"; 45313 [labelType="html" label="MapPartitionsRDD [45313] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105453 { label="CartesianProduct"; 45314 [labelType="html" label="UnsafeCartesianRDD [45314] [Unordered]<br>parquet at PersistJob.java:35"]; 45315 [labelType="html" label="MapPartitionsRDD [45315] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105467 { label="Scan csv "; 45316 [labelType="html" label="FileScanRDD [45316]<br>parquet at PersistJob.java:35"]; 45317 [labelType="html" label="MapPartitionsRDD [45317]<br>parquet at PersistJob.java:35"]; } subgraph cluster105463 { label="WholeStageCodegen (26)"; 45318 [labelType="html" label="MapPartitionsRDD [45318]<br>parquet at PersistJob.java:35"]; } subgraph cluster105452 { label="CartesianProduct"; 45319 [labelType="html" label="UnsafeCartesianRDD [45319] [Unordered]<br>parquet at PersistJob.java:35"]; 45320 [labelType="html" label="MapPartitionsRDD [45320] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105448 { label="WholeStageCodegen (27)"; 45321 [labelType="html" label="MapPartitionsRDD [45321] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105447 { label="ObjectHashAggregate"; 45322 [labelType="html" label="MapPartitionsRDD [45322] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105446 { label="Exchange"; 45323 [labelType="html" label="MapPartitionsRDD [45323] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45309->45310; 45310->45311; 45312->45313; 45311->45314; 45313->45314; 45314->45315; 45316->45317; 45317->45318; 45315->45319; 45318->45319; 45319->45320; 45320->45321; 45321->45322; 45322->45323; }
45228,45312
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time