3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16090 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
95 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
481.2 KiB / 45934
Shuffle Write Size / Records:
419.5 KiB / 45934
Associated Job Ids:
7859
DAG Visualization
digraph G { subgraph clusterstage_16090 { label="Stage 16090"; subgraph cluster102876 { label="AQEShuffleRead"; 43981 [labelType="html" label="ShuffledRowRDD [43981] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102873 { label="WholeStageCodegen (4)"; 43982 [labelType="html" label="MapPartitionsRDD [43982] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102872 { label="Window"; 43983 [labelType="html" label="MapPartitionsRDD [43983] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102868 { label="WholeStageCodegen (5)"; 43984 [labelType="html" label="MapPartitionsRDD [43984] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102881 { label="Scan csv "; 43985 [labelType="html" label="FileScanRDD [43985]<br>parquet at PersistJob.java:35"]; 43986 [labelType="html" label="MapPartitionsRDD [43986]<br>parquet at PersistJob.java:35"]; } subgraph cluster102877 { label="WholeStageCodegen (6)"; 43987 [labelType="html" label="MapPartitionsRDD [43987]<br>parquet at PersistJob.java:35"]; } subgraph cluster102867 { label="CartesianProduct"; 43988 [labelType="html" label="UnsafeCartesianRDD [43988] [Unordered]<br>parquet at PersistJob.java:35"]; 43989 [labelType="html" label="MapPartitionsRDD [43989] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102864 { label="WholeStageCodegen (7)"; 43990 [labelType="html" label="MapPartitionsRDD [43990] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102863 { label="Exchange"; 43991 [labelType="html" label="MapPartitionsRDD [43991] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43981->43982; 43982->43983; 43983->43984; 43985->43986; 43986->43987; 43984->43988; 43987->43988; 43988->43989; 43989->43990; 43990->43991; }
43971,43981
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time