3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16030 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
499.8 KiB / 45934
Shuffle Write Size / Records:
454.6 KiB / 45934
Associated Job Ids:
7822
DAG Visualization
digraph G { subgraph clusterstage_16030 { label="Stage 16030"; subgraph cluster102296 { label="AQEShuffleRead"; 43702 [labelType="html" label="ShuffledRowRDD [43702] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102293 { label="WholeStageCodegen (4)"; 43703 [labelType="html" label="MapPartitionsRDD [43703] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102292 { label="Window"; 43705 [labelType="html" label="MapPartitionsRDD [43705] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102288 { label="WholeStageCodegen (5)"; 43706 [labelType="html" label="MapPartitionsRDD [43706] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102303 { label="Scan csv "; 43708 [labelType="html" label="FileScanRDD [43708]<br>parquet at PersistJob.java:35"]; 43709 [labelType="html" label="MapPartitionsRDD [43709]<br>parquet at PersistJob.java:35"]; } subgraph cluster102299 { label="WholeStageCodegen (6)"; 43710 [labelType="html" label="MapPartitionsRDD [43710]<br>parquet at PersistJob.java:35"]; } subgraph cluster102287 { label="CartesianProduct"; 43711 [labelType="html" label="UnsafeCartesianRDD [43711] [Unordered]<br>parquet at PersistJob.java:35"]; 43712 [labelType="html" label="MapPartitionsRDD [43712] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102284 { label="WholeStageCodegen (7)"; 43713 [labelType="html" label="MapPartitionsRDD [43713] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster102283 { label="Exchange"; 43714 [labelType="html" label="MapPartitionsRDD [43714] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43702->43703; 43703->43705; 43705->43706; 43708->43709; 43709->43710; 43706->43711; 43710->43711; 43711->43712; 43712->43713; 43713->43714; }
43693,43702
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time