3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14682 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Input Size / Records:
3.5 KiB / 1
Shuffle Read Size / Records:
892.3 KiB / 44963
Shuffle Write Size / Records:
685.5 KiB / 36518
Associated Job Ids:
7818
DAG Visualization
digraph G { subgraph clusterstage_14682 { label="Stage 14682"; subgraph cluster95139 { label="AQEShuffleRead"; 40135 [labelType="html" label="ShuffledRowRDD [40135] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95136 { label="WholeStageCodegen (9)"; 40136 [labelType="html" label="MapPartitionsRDD [40136] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95135 { label="Window"; 40137 [labelType="html" label="MapPartitionsRDD [40137] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95132 { label="WholeStageCodegen (10)"; 40138 [labelType="html" label="MapPartitionsRDD [40138] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95131 { label="Window"; 40139 [labelType="html" label="MapPartitionsRDD [40139] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95127 { label="WholeStageCodegen (11)"; 40140 [labelType="html" label="MapPartitionsRDD [40140] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95144 { label="Scan parquet "; 40141 [labelType="html" label="FileScanRDD [40141]<br>parquet at PersistJob.java:35"]; 40142 [labelType="html" label="MapPartitionsRDD [40142]<br>parquet at PersistJob.java:35"]; } subgraph cluster95140 { label="WholeStageCodegen (12)"; 40143 [labelType="html" label="MapPartitionsRDD [40143]<br>parquet at PersistJob.java:35"]; } subgraph cluster95126 { label="CartesianProduct"; 40144 [labelType="html" label="UnsafeCartesianRDD [40144] [Unordered]<br>parquet at PersistJob.java:35"]; 40145 [labelType="html" label="MapPartitionsRDD [40145] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95123 { label="WholeStageCodegen (13)"; 40146 [labelType="html" label="MapPartitionsRDD [40146] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95122 { label="Exchange"; 40147 [labelType="html" label="MapPartitionsRDD [40147] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40135->40136; 40136->40137; 40137->40138; 40138->40139; 40139->40140; 40141->40142; 40142->40143; 40140->40144; 40143->40144; 40144->40145; 40145->40146; 40146->40147; }
40134,40135
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time