3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15828 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.9 MiB / 2231133
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
399.0 B / 2
Associated Job Ids:
8004
DAG Visualization
digraph G { subgraph clusterstage_15828 { label="Stage 15828"; subgraph cluster103425 { label="Scan parquet "; 44295 [labelType="html" label="FileScanRDD [44295]<br>parquet at PersistJob.java:35"]; 44296 [labelType="html" label="MapPartitionsRDD [44296]<br>parquet at PersistJob.java:35"]; } subgraph cluster103420 { label="WholeStageCodegen (25)"; 44297 [labelType="html" label="MapPartitionsRDD [44297]<br>parquet at PersistJob.java:35"]; } subgraph cluster103428 { label="Exchange"; 44298 [labelType="html" label="ShuffledRowRDD [44298] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103426 { label="ObjectHashAggregate"; 44299 [labelType="html" label="MapPartitionsRDD [44299] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103419 { label="CartesianProduct"; 44300 [labelType="html" label="UnsafeCartesianRDD [44300] [Unordered]<br>parquet at PersistJob.java:35"]; 44301 [labelType="html" label="MapPartitionsRDD [44301] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103433 { label="Scan csv "; 44302 [labelType="html" label="FileScanRDD [44302]<br>parquet at PersistJob.java:35"]; 44303 [labelType="html" label="MapPartitionsRDD [44303]<br>parquet at PersistJob.java:35"]; } subgraph cluster103429 { label="WholeStageCodegen (26)"; 44304 [labelType="html" label="MapPartitionsRDD [44304]<br>parquet at PersistJob.java:35"]; } subgraph cluster103418 { label="CartesianProduct"; 44305 [labelType="html" label="UnsafeCartesianRDD [44305] [Unordered]<br>parquet at PersistJob.java:35"]; 44306 [labelType="html" label="MapPartitionsRDD [44306] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103414 { label="WholeStageCodegen (27)"; 44307 [labelType="html" label="MapPartitionsRDD [44307] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103413 { label="ObjectHashAggregate"; 44308 [labelType="html" label="MapPartitionsRDD [44308] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103412 { label="Exchange"; 44309 [labelType="html" label="MapPartitionsRDD [44309] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44295->44296; 44296->44297; 44298->44299; 44297->44300; 44299->44300; 44300->44301; 44302->44303; 44303->44304; 44301->44305; 44304->44305; 44305->44306; 44306->44307; 44307->44308; 44308->44309; }
44214,44298
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time