3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 21143 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
656.5 KiB / 21591
Shuffle Write Size / Records:
658.1 KiB / 21131
Associated Job Ids:
10605
DAG Visualization
digraph G { subgraph clusterstage_21143 { label="Stage 21143"; subgraph cluster138655 { label="AQEShuffleRead"; 60133 [labelType="html" label="ShuffledRowRDD [60133] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138652 { label="WholeStageCodegen (8)"; 60134 [labelType="html" label="MapPartitionsRDD [60134] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138661 { label="AQEShuffleRead"; 60135 [labelType="html" label="ShuffledRowRDD [60135] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138660 { label="ObjectHashAggregate"; 60136 [labelType="html" label="MapPartitionsRDD [60136] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138657 { label="WholeStageCodegen (9)"; 60137 [labelType="html" label="MapPartitionsRDD [60137] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138648 { label="WholeStageCodegen (10)"; 60138 [labelType="html" label="ZippedPartitionsRDD2 [60138] [Unordered]<br>count at ColumnStatJob.java:47"]; 60139 [labelType="html" label="MapPartitionsRDD [60139] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster138647 { label="Exchange"; 60140 [labelType="html" label="MapPartitionsRDD [60140] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 60133->60134; 60135->60136; 60136->60137; 60134->60138; 60137->60138; 60138->60139; 60139->60140; }
60132,60133
60120,60135
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time