3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15744 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
26 s
Locality Level Summary:
Any: 10
Input Size / Records:
15.5 MiB / 2231133
Shuffle Read Size / Records:
3.4 KiB / 10
Shuffle Write Size / Records:
4.9 KiB / 99
Associated Job Ids:
7978
DAG Visualization
digraph G { subgraph clusterstage_15744 { label="Stage 15744"; subgraph cluster102992 { label="Scan parquet "; 44049 [labelType="html" label="FileScanRDD [44049]<br>rdd at PersistJob.java:28"]; 44050 [labelType="html" label="MapPartitionsRDD [44050]<br>rdd at PersistJob.java:28"]; } subgraph cluster102987 { label="WholeStageCodegen (34)"; 44051 [labelType="html" label="MapPartitionsRDD [44051]<br>rdd at PersistJob.java:28"]; } subgraph cluster102995 { label="Exchange"; 44052 [labelType="html" label="ShuffledRowRDD [44052] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102993 { label="ObjectHashAggregate"; 44053 [labelType="html" label="MapPartitionsRDD [44053] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102986 { label="CartesianProduct"; 44054 [labelType="html" label="UnsafeCartesianRDD [44054] [Unordered]<br>rdd at PersistJob.java:28"]; 44055 [labelType="html" label="MapPartitionsRDD [44055] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster103000 { label="Scan csv "; 44056 [labelType="html" label="FileScanRDD [44056]<br>rdd at PersistJob.java:28"]; 44057 [labelType="html" label="MapPartitionsRDD [44057]<br>rdd at PersistJob.java:28"]; } subgraph cluster102996 { label="WholeStageCodegen (35)"; 44058 [labelType="html" label="MapPartitionsRDD [44058]<br>rdd at PersistJob.java:28"]; } subgraph cluster102985 { label="CartesianProduct"; 44059 [labelType="html" label="UnsafeCartesianRDD [44059] [Unordered]<br>rdd at PersistJob.java:28"]; 44060 [labelType="html" label="MapPartitionsRDD [44060] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102981 { label="WholeStageCodegen (36)"; 44061 [labelType="html" label="MapPartitionsRDD [44061] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102980 { label="ObjectHashAggregate"; 44062 [labelType="html" label="MapPartitionsRDD [44062] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102979 { label="Exchange"; 44063 [labelType="html" label="MapPartitionsRDD [44063] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44049->44050; 44050->44051; 44052->44053; 44051->44054; 44053->44054; 44054->44055; 44056->44057; 44057->44058; 44055->44059; 44058->44059; 44059->44060; 44060->44061; 44061->44062; 44062->44063; }
43949,44052
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time