3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7471 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
76 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.0 KiB / 284
Shuffle Write Size / Records:
190.0 B / 7
Associated Job Ids:
3643
DAG Visualization
digraph G { subgraph clusterstage_7471 { label="Stage 7471"; subgraph cluster47037 { label="AQEShuffleRead"; 20406 [labelType="html" label="ShuffledRowRDD [20406] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47034 { label="WholeStageCodegen (23)"; 20407 [labelType="html" label="MapPartitionsRDD [20407] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47042 { label="AQEShuffleRead"; 20408 [labelType="html" label="ShuffledRowRDD [20408] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47039 { label="WholeStageCodegen (24)"; 20409 [labelType="html" label="MapPartitionsRDD [20409] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47030 { label="WholeStageCodegen (25)"; 20410 [labelType="html" label="ZippedPartitionsRDD2 [20410] [Unordered]<br>count at ColumnStatJob.java:47"]; 20411 [labelType="html" label="MapPartitionsRDD [20411] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47047 { label="AQEShuffleRead"; 20412 [labelType="html" label="ShuffledRowRDD [20412] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47044 { label="WholeStageCodegen (26)"; 20413 [labelType="html" label="MapPartitionsRDD [20413] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47026 { label="WholeStageCodegen (27)"; 20414 [labelType="html" label="ZippedPartitionsRDD2 [20414] [Unordered]<br>count at ColumnStatJob.java:47"]; 20415 [labelType="html" label="MapPartitionsRDD [20415] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47052 { label="AQEShuffleRead"; 20416 [labelType="html" label="ShuffledRowRDD [20416] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47049 { label="WholeStageCodegen (28)"; 20417 [labelType="html" label="MapPartitionsRDD [20417] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47022 { label="WholeStageCodegen (29)"; 20418 [labelType="html" label="ZippedPartitionsRDD2 [20418] [Unordered]<br>count at ColumnStatJob.java:47"]; 20419 [labelType="html" label="MapPartitionsRDD [20419] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster47021 { label="Exchange"; 20420 [labelType="html" label="MapPartitionsRDD [20420] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 20406->20407; 20408->20409; 20407->20410; 20409->20410; 20410->20411; 20412->20413; 20411->20414; 20413->20414; 20414->20415; 20416->20417; 20415->20418; 20417->20418; 20418->20419; 20419->20420; }
20405,20406
20357,20408
20361,20412
20365,20416
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time