3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15738 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 10
Input Size / Records:
13.9 MiB / 2231133
Shuffle Read Size / Records:
4.7 KiB / 10
Shuffle Write Size / Records:
399.0 B / 2
Associated Job Ids:
7975
DAG Visualization
digraph G { subgraph clusterstage_15738 { label="Stage 15738"; subgraph cluster102926 { label="Scan parquet "; 44004 [labelType="html" label="FileScanRDD [44004]<br>rdd at PersistJob.java:28"]; 44005 [labelType="html" label="MapPartitionsRDD [44005]<br>rdd at PersistJob.java:28"]; } subgraph cluster102921 { label="WholeStageCodegen (25)"; 44006 [labelType="html" label="MapPartitionsRDD [44006]<br>rdd at PersistJob.java:28"]; } subgraph cluster102929 { label="Exchange"; 44007 [labelType="html" label="ShuffledRowRDD [44007] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102927 { label="ObjectHashAggregate"; 44008 [labelType="html" label="MapPartitionsRDD [44008] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102920 { label="CartesianProduct"; 44009 [labelType="html" label="UnsafeCartesianRDD [44009] [Unordered]<br>rdd at PersistJob.java:28"]; 44010 [labelType="html" label="MapPartitionsRDD [44010] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102934 { label="Scan csv "; 44011 [labelType="html" label="FileScanRDD [44011]<br>rdd at PersistJob.java:28"]; 44012 [labelType="html" label="MapPartitionsRDD [44012]<br>rdd at PersistJob.java:28"]; } subgraph cluster102930 { label="WholeStageCodegen (26)"; 44013 [labelType="html" label="MapPartitionsRDD [44013]<br>rdd at PersistJob.java:28"]; } subgraph cluster102919 { label="CartesianProduct"; 44014 [labelType="html" label="UnsafeCartesianRDD [44014] [Unordered]<br>rdd at PersistJob.java:28"]; 44015 [labelType="html" label="MapPartitionsRDD [44015] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102915 { label="WholeStageCodegen (27)"; 44016 [labelType="html" label="MapPartitionsRDD [44016] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102914 { label="ObjectHashAggregate"; 44017 [labelType="html" label="MapPartitionsRDD [44017] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster102913 { label="Exchange"; 44018 [labelType="html" label="MapPartitionsRDD [44018] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44004->44005; 44005->44006; 44007->44008; 44006->44009; 44008->44009; 44009->44010; 44011->44012; 44012->44013; 44010->44014; 44013->44014; 44014->44015; 44015->44016; 44016->44017; 44017->44018; }
43923,44007
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time