3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15809 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.9 MiB / 85932
Shuffle Write Size / Records:
6.7 MiB / 85895
Associated Job Ids:
7737
DAG Visualization
digraph G { subgraph clusterstage_15809 { label="Stage 15809"; subgraph cluster100916 { label="AQEShuffleRead"; 43102 [labelType="html" label="ShuffledRowRDD [43102] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100913 { label="WholeStageCodegen (43)"; 43103 [labelType="html" label="MapPartitionsRDD [43103] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100921 { label="AQEShuffleRead"; 43104 [labelType="html" label="ShuffledRowRDD [43104] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100918 { label="WholeStageCodegen (44)"; 43105 [labelType="html" label="MapPartitionsRDD [43105] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100907 { label="WholeStageCodegen (45)"; 43106 [labelType="html" label="ZippedPartitionsRDD2 [43106] [Unordered]<br>parquet at PersistJob.java:35"]; 43107 [labelType="html" label="MapPartitionsRDD [43107] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100926 { label="AQEShuffleRead"; 43108 [labelType="html" label="ShuffledRowRDD [43108] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100923 { label="WholeStageCodegen (46)"; 43109 [labelType="html" label="MapPartitionsRDD [43109] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100902 { label="WholeStageCodegen (47)"; 43110 [labelType="html" label="ZippedPartitionsRDD2 [43110] [Unordered]<br>parquet at PersistJob.java:35"]; 43111 [labelType="html" label="MapPartitionsRDD [43111] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster100901 { label="Exchange"; 43112 [labelType="html" label="MapPartitionsRDD [43112] [Unordered]<br>parquet at PersistJob.java:35"]; } } 43102->43103; 43104->43105; 43103->43106; 43105->43106; 43106->43107; 43108->43109; 43107->43110; 43109->43110; 43110->43111; 43111->43112; }
43101,43102
43025,43104
43029,43108
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time