3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7994 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.7 KiB / 284
Shuffle Write Size / Records:
793.0 B / 7
Associated Job Ids:
3800
DAG Visualization
digraph G { subgraph clusterstage_7994 { label="Stage 7994"; subgraph cluster49464 { label="AQEShuffleRead"; 21355 [labelType="html" label="ShuffledRowRDD [21355] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49461 { label="WholeStageCodegen (24)"; 21356 [labelType="html" label="MapPartitionsRDD [21356] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49469 { label="AQEShuffleRead"; 21357 [labelType="html" label="ShuffledRowRDD [21357] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49466 { label="WholeStageCodegen (25)"; 21358 [labelType="html" label="MapPartitionsRDD [21358] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49457 { label="WholeStageCodegen (26)"; 21359 [labelType="html" label="ZippedPartitionsRDD2 [21359] [Unordered]<br>parquet at PersistJob.java:35"]; 21360 [labelType="html" label="MapPartitionsRDD [21360] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49474 { label="AQEShuffleRead"; 21361 [labelType="html" label="ShuffledRowRDD [21361] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49471 { label="WholeStageCodegen (27)"; 21362 [labelType="html" label="MapPartitionsRDD [21362] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49453 { label="WholeStageCodegen (28)"; 21363 [labelType="html" label="ZippedPartitionsRDD2 [21363] [Unordered]<br>parquet at PersistJob.java:35"]; 21364 [labelType="html" label="MapPartitionsRDD [21364] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49479 { label="AQEShuffleRead"; 21365 [labelType="html" label="ShuffledRowRDD [21365] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49476 { label="WholeStageCodegen (29)"; 21366 [labelType="html" label="MapPartitionsRDD [21366] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49449 { label="WholeStageCodegen (30)"; 21367 [labelType="html" label="ZippedPartitionsRDD2 [21367] [Unordered]<br>parquet at PersistJob.java:35"]; 21368 [labelType="html" label="MapPartitionsRDD [21368] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster49448 { label="Exchange"; 21369 [labelType="html" label="MapPartitionsRDD [21369] [Unordered]<br>parquet at PersistJob.java:35"]; } } 21355->21356; 21357->21358; 21356->21359; 21358->21359; 21359->21360; 21361->21362; 21360->21363; 21362->21363; 21363->21364; 21365->21366; 21364->21367; 21366->21367; 21367->21368; 21368->21369; }
21354,21355
21305,21357
21309,21361
21313,21365
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time