3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8185 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.0 KiB / 284
Shuffle Write Size / Records:
190.0 B / 7
Associated Job Ids:
3883
DAG Visualization
digraph G { subgraph clusterstage_8185 { label="Stage 8185"; subgraph cluster50670 { label="AQEShuffleRead"; 21849 [labelType="html" label="ShuffledRowRDD [21849] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50667 { label="WholeStageCodegen (23)"; 21850 [labelType="html" label="MapPartitionsRDD [21850] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50675 { label="AQEShuffleRead"; 21851 [labelType="html" label="ShuffledRowRDD [21851] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50672 { label="WholeStageCodegen (24)"; 21852 [labelType="html" label="MapPartitionsRDD [21852] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50663 { label="WholeStageCodegen (25)"; 21853 [labelType="html" label="ZippedPartitionsRDD2 [21853] [Unordered]<br>count at ColumnStatJob.java:47"]; 21854 [labelType="html" label="MapPartitionsRDD [21854] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50680 { label="AQEShuffleRead"; 21855 [labelType="html" label="ShuffledRowRDD [21855] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50677 { label="WholeStageCodegen (26)"; 21856 [labelType="html" label="MapPartitionsRDD [21856] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50659 { label="WholeStageCodegen (27)"; 21857 [labelType="html" label="ZippedPartitionsRDD2 [21857] [Unordered]<br>count at ColumnStatJob.java:47"]; 21858 [labelType="html" label="MapPartitionsRDD [21858] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50685 { label="AQEShuffleRead"; 21859 [labelType="html" label="ShuffledRowRDD [21859] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50682 { label="WholeStageCodegen (28)"; 21860 [labelType="html" label="MapPartitionsRDD [21860] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50655 { label="WholeStageCodegen (29)"; 21861 [labelType="html" label="ZippedPartitionsRDD2 [21861] [Unordered]<br>count at ColumnStatJob.java:47"]; 21862 [labelType="html" label="MapPartitionsRDD [21862] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster50654 { label="Exchange"; 21863 [labelType="html" label="MapPartitionsRDD [21863] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 21849->21850; 21851->21852; 21850->21853; 21852->21853; 21853->21854; 21855->21856; 21854->21857; 21856->21857; 21857->21858; 21859->21860; 21858->21861; 21860->21861; 21861->21862; 21862->21863; }
21848,21849
21800,21851
21804,21855
21808,21859
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time