3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15832 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.8 MiB / 2231133
Shuffle Read Size / Records:
1840.0 B / 10
Shuffle Write Size / Records:
26.9 KiB / 945
Associated Job Ids:
8006
DAG Visualization
digraph G { subgraph clusterstage_15832 { label="Stage 15832"; subgraph cluster103469 { label="Scan parquet "; 44325 [labelType="html" label="FileScanRDD [44325]<br>parquet at PersistJob.java:35"]; 44326 [labelType="html" label="MapPartitionsRDD [44326]<br>parquet at PersistJob.java:35"]; } subgraph cluster103464 { label="WholeStageCodegen (31)"; 44327 [labelType="html" label="MapPartitionsRDD [44327]<br>parquet at PersistJob.java:35"]; } subgraph cluster103472 { label="Exchange"; 44328 [labelType="html" label="ShuffledRowRDD [44328] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103470 { label="ObjectHashAggregate"; 44329 [labelType="html" label="MapPartitionsRDD [44329] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103463 { label="CartesianProduct"; 44330 [labelType="html" label="UnsafeCartesianRDD [44330] [Unordered]<br>parquet at PersistJob.java:35"]; 44331 [labelType="html" label="MapPartitionsRDD [44331] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103477 { label="Scan csv "; 44332 [labelType="html" label="FileScanRDD [44332]<br>parquet at PersistJob.java:35"]; 44333 [labelType="html" label="MapPartitionsRDD [44333]<br>parquet at PersistJob.java:35"]; } subgraph cluster103473 { label="WholeStageCodegen (32)"; 44334 [labelType="html" label="MapPartitionsRDD [44334]<br>parquet at PersistJob.java:35"]; } subgraph cluster103462 { label="CartesianProduct"; 44335 [labelType="html" label="UnsafeCartesianRDD [44335] [Unordered]<br>parquet at PersistJob.java:35"]; 44336 [labelType="html" label="MapPartitionsRDD [44336] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103458 { label="WholeStageCodegen (33)"; 44337 [labelType="html" label="MapPartitionsRDD [44337] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103457 { label="ObjectHashAggregate"; 44338 [labelType="html" label="MapPartitionsRDD [44338] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103456 { label="Exchange"; 44339 [labelType="html" label="MapPartitionsRDD [44339] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44325->44326; 44326->44327; 44328->44329; 44327->44330; 44329->44330; 44330->44331; 44332->44333; 44333->44334; 44331->44335; 44334->44335; 44335->44336; 44336->44337; 44337->44338; 44338->44339; }
44235,44328
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time