3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15587 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Input Size / Records:
3.5 KiB / 1
Shuffle Read Size / Records:
892.3 KiB / 44963
Shuffle Write Size / Records:
685.5 KiB / 36518
Associated Job Ids:
7686
DAG Visualization
digraph G { subgraph clusterstage_15587 { label="Stage 15587"; subgraph cluster100144 { label="AQEShuffleRead"; 42756 [labelType="html" label="ShuffledRowRDD [42756] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100141 { label="WholeStageCodegen (9)"; 42757 [labelType="html" label="MapPartitionsRDD [42757] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100140 { label="Window"; 42758 [labelType="html" label="MapPartitionsRDD [42758] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100137 { label="WholeStageCodegen (10)"; 42759 [labelType="html" label="MapPartitionsRDD [42759] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100136 { label="Window"; 42760 [labelType="html" label="MapPartitionsRDD [42760] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100132 { label="WholeStageCodegen (11)"; 42761 [labelType="html" label="MapPartitionsRDD [42761] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100149 { label="Scan parquet "; 42762 [labelType="html" label="FileScanRDD [42762]<br>parquet at PersistJob.java:35"]; 42763 [labelType="html" label="MapPartitionsRDD [42763]<br>parquet at PersistJob.java:35"]; } subgraph cluster100145 { label="WholeStageCodegen (12)"; 42764 [labelType="html" label="MapPartitionsRDD [42764]<br>parquet at PersistJob.java:35"]; } subgraph cluster100131 { label="CartesianProduct"; 42765 [labelType="html" label="UnsafeCartesianRDD [42765] [Unordered]<br>parquet at PersistJob.java:35"]; 42766 [labelType="html" label="MapPartitionsRDD [42766] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100128 { label="WholeStageCodegen (13)"; 42767 [labelType="html" label="MapPartitionsRDD [42767] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100127 { label="Exchange"; 42768 [labelType="html" label="MapPartitionsRDD [42768] [Unordered]<br>parquet at PersistJob.java:35"]; } } 42756->42757; 42757->42758; 42758->42759; 42759->42760; 42760->42761; 42762->42763; 42763->42764; 42761->42765; 42764->42765; 42765->42766; 42766->42767; 42767->42768; }
42745,42756
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time