3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8054 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
10 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
45.5 KiB / 6419
Shuffle Write Size / Records:
36.2 KiB / 6213
Associated Job Ids:
4130
DAG Visualization
digraph G { subgraph clusterstage_8054 { label="Stage 8054"; subgraph cluster53693 { label="AQEShuffleRead"; 22943 [labelType="html" label="ShuffledRowRDD [22943] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster53690 { label="WholeStageCodegen (10)"; 22944 [labelType="html" label="MapPartitionsRDD [22944] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster53698 { label="AQEShuffleRead"; 22945 [labelType="html" label="ShuffledRowRDD [22945] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster53695 { label="WholeStageCodegen (11)"; 22946 [labelType="html" label="MapPartitionsRDD [22946] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster53686 { label="WholeStageCodegen (12)"; 22947 [labelType="html" label="ZippedPartitionsRDD2 [22947] [Unordered]<br>count at ColumnStatJob.java:47"]; 22948 [labelType="html" label="MapPartitionsRDD [22948] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster53685 { label="Exchange"; 22949 [labelType="html" label="MapPartitionsRDD [22949] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 22943->22944; 22945->22946; 22944->22947; 22946->22947; 22947->22948; 22948->22949; }
22942,22943
22930,22945
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time