3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17155 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
21 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
97.9 MiB / 2124462
Shuffle Read Size / Records:
11.4 MiB / 261221
Shuffle Write Size / Records:
116.4 MiB / 2127386
Associated Job Ids:
8342
DAG Visualization
digraph G { subgraph clusterstage_17155 { label="Stage 17155"; subgraph cluster109942 { label="Exchange"; 46978 [labelType="html" label="ShuffledRowRDD [46978] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109938 { label="WholeStageCodegen (18)"; 46979 [labelType="html" label="MapPartitionsRDD [46979] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109937 { label="Window"; 46980 [labelType="html" label="MapPartitionsRDD [46980] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109935 { label="Filter"; 46981 [labelType="html" label="MapPartitionsRDD [46981] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109934 { label="Project"; 46982 [labelType="html" label="MapPartitionsRDD [46982] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109933 { label="Project"; 46983 [labelType="html" label="MapPartitionsRDD [46983] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109932 { label="Project"; 46984 [labelType="html" label="MapPartitionsRDD [46984] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109931 { label="Project"; 46985 [labelType="html" label="MapPartitionsRDD [46985] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109930 { label="Project"; 46986 [labelType="html" label="MapPartitionsRDD [46986] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109948 { label="Scan parquet "; 46987 [labelType="html" label="FileScanRDD [46987]<br>parquet at PersistJob.java:35"]; 46988 [labelType="html" label="MapPartitionsRDD [46988]<br>parquet at PersistJob.java:35"]; } subgraph cluster109943 { label="WholeStageCodegen (20)"; 46989 [labelType="html" label="MapPartitionsRDD [46989]<br>parquet at PersistJob.java:35"]; } subgraph cluster109921 { label="Union"; 46990 [labelType="html" label="UnionRDD [46990] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster109920 { label="Exchange"; 46994 [labelType="html" label="MapPartitionsRDD [46994] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46978->46979; 46979->46980; 46980->46981; 46981->46982; 46982->46983; 46983->46984; 46984->46985; 46985->46986; 46987->46988; 46988->46989; 46986->46990; 46989->46990; 46990->46994; }
46977,46978
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time