3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5675 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
891.4 KiB / 29323
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
3054
DAG Visualization
digraph G { subgraph clusterstage_5675 { label="Stage 5675"; subgraph cluster35836 { label="AQEShuffleRead"; 14858 [labelType="html" label="ShuffledRowRDD [14858] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35833 { label="WholeStageCodegen (7)"; 14859 [labelType="html" label="MapPartitionsRDD [14859] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35832 { label="Window"; 14860 [labelType="html" label="MapPartitionsRDD [14860] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35829 { label="WholeStageCodegen (8)"; 14861 [labelType="html" label="MapPartitionsRDD [14861] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35841 { label="AQEShuffleRead"; 14862 [labelType="html" label="ShuffledRowRDD [14862] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35838 { label="WholeStageCodegen (9)"; 14863 [labelType="html" label="MapPartitionsRDD [14863] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35822 { label="WholeStageCodegen (10)"; 14864 [labelType="html" label="ZippedPartitionsRDD2 [14864] [Unordered]<br>count at ColumnStatJob.java:47"]; 14865 [labelType="html" label="MapPartitionsRDD [14865] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35821 { label="Window"; 14866 [labelType="html" label="MapPartitionsRDD [14866] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35816 { label="WholeStageCodegen (11)"; 14867 [labelType="html" label="MapPartitionsRDD [14867] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster35815 { label="Exchange"; 14868 [labelType="html" label="MapPartitionsRDD [14868] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 14858->14859; 14859->14860; 14860->14861; 14862->14863; 14861->14864; 14863->14864; 14864->14865; 14865->14866; 14866->14867; 14867->14868; }
14843,14858
14838,14862
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time