3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 14925 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 5
Output Size / Records:
4.6 MiB / 85895
Shuffle Read Size / Records:
6.7 MiB / 85895
Associated Job Ids:
7871
DAG Visualization
digraph G { subgraph clusterstage_14925 { label="Stage 14925"; subgraph cluster95969 { label="AQEShuffleRead"; 40502 [labelType="html" label="ShuffledRowRDD [40502] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95966 { label="WholeStageCodegen (48)"; 40503 [labelType="html" label="MapPartitionsRDD [40503] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95965 { label="Window"; 40504 [labelType="html" label="MapPartitionsRDD [40504] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95961 { label="WholeStageCodegen (49)"; 40505 [labelType="html" label="MapPartitionsRDD [40505] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95960 { label="Window"; 40506 [labelType="html" label="MapPartitionsRDD [40506] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95957 { label="WholeStageCodegen (50)"; 40507 [labelType="html" label="MapPartitionsRDD [40507] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95956 { label="Window"; 40508 [labelType="html" label="MapPartitionsRDD [40508] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95950 { label="WholeStageCodegen (51)"; 40509 [labelType="html" label="MapPartitionsRDD [40509] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95949 { label="Window"; 40510 [labelType="html" label="MapPartitionsRDD [40510] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95945 { label="WholeStageCodegen (52)"; 40511 [labelType="html" label="MapPartitionsRDD [40511] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95944 { label="Window"; 40512 [labelType="html" label="MapPartitionsRDD [40512] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95940 { label="WholeStageCodegen (53)"; 40513 [labelType="html" label="MapPartitionsRDD [40513] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95939 { label="Window"; 40514 [labelType="html" label="MapPartitionsRDD [40514] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95936 { label="WholeStageCodegen (54)"; 40515 [labelType="html" label="MapPartitionsRDD [40515] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster95935 { label="WriteFiles"; 40516 [labelType="html" label="MapPartitionsRDD [40516] [Unordered]<br>parquet at PersistJob.java:35"]; } } 40502->40503; 40503->40504; 40504->40505; 40505->40506; 40506->40507; 40507->40508; 40508->40509; 40509->40510; 40510->40511; 40511->40512; 40512->40513; 40513->40514; 40514->40515; 40515->40516; }
40501,40502
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time