3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7960 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.4 MiB / 358608
Shuffle Write Size / Records:
11.4 MiB / 262408
Associated Job Ids:
3890
DAG Visualization
digraph G { subgraph clusterstage_7960 { label="Stage 7960"; subgraph cluster51996 { label="Exchange"; 22960 [labelType="html" label="ShuffledRowRDD [22960] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51992 { label="WholeStageCodegen (12)"; 22961 [labelType="html" label="MapPartitionsRDD [22961] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51991 { label="Window"; 22962 [labelType="html" label="MapPartitionsRDD [22962] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51987 { label="WholeStageCodegen (13)"; 22963 [labelType="html" label="MapPartitionsRDD [22963] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52008 { label="AQEShuffleRead"; 22964 [labelType="html" label="ShuffledRowRDD [22964] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52005 { label="WholeStageCodegen (14)"; 22965 [labelType="html" label="MapPartitionsRDD [22965] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52015 { label="AQEShuffleRead"; 22966 [labelType="html" label="ShuffledRowRDD [22966] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52014 { label="ObjectHashAggregate"; 22967 [labelType="html" label="MapPartitionsRDD [22967] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52010 { label="WholeStageCodegen (15)"; 22968 [labelType="html" label="MapPartitionsRDD [22968] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51997 { label="WholeStageCodegen (16)"; 22969 [labelType="html" label="ZippedPartitionsRDD2 [22969] [Unordered]<br>rdd at PersistJob.java:28"]; 22970 [labelType="html" label="MapPartitionsRDD [22970] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51986 { label="Union"; 22971 [labelType="html" label="UnionRDD [22971] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster52020 { label="Scan csv "; 22972 [labelType="html" label="FileScanRDD [22972]<br>rdd at PersistJob.java:28"]; 22973 [labelType="html" label="MapPartitionsRDD [22973]<br>rdd at PersistJob.java:28"]; } subgraph cluster52016 { label="WholeStageCodegen (17)"; 22974 [labelType="html" label="MapPartitionsRDD [22974]<br>rdd at PersistJob.java:28"]; } subgraph cluster51985 { label="CartesianProduct"; 22975 [labelType="html" label="UnsafeCartesianRDD [22975] [Unordered]<br>rdd at PersistJob.java:28"]; 22976 [labelType="html" label="MapPartitionsRDD [22976] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster51984 { label="Exchange"; 22977 [labelType="html" label="MapPartitionsRDD [22977] [Unordered]<br>rdd at PersistJob.java:28"]; } } 22960->22961; 22961->22962; 22962->22963; 22964->22965; 22966->22967; 22967->22968; 22965->22969; 22968->22969; 22969->22970; 22963->22971; 22970->22971; 22972->22973; 22973->22974; 22971->22975; 22974->22975; 22975->22976; 22976->22977; }
22959,22960
22942,22964
22952,22966
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time