3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8590 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
24.7 MiB / 358608
Shuffle Write Size / Records:
10.4 MiB / 262408
Associated Job Ids:
4250
DAG Visualization
digraph G { subgraph clusterstage_8590 { label="Stage 8590"; subgraph cluster56249 { label="Exchange"; 24650 [labelType="html" label="ShuffledRowRDD [24650] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56245 { label="WholeStageCodegen (12)"; 24651 [labelType="html" label="MapPartitionsRDD [24651] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56244 { label="Window"; 24652 [labelType="html" label="MapPartitionsRDD [24652] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56240 { label="WholeStageCodegen (13)"; 24653 [labelType="html" label="MapPartitionsRDD [24653] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56261 { label="AQEShuffleRead"; 24654 [labelType="html" label="ShuffledRowRDD [24654] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56258 { label="WholeStageCodegen (14)"; 24655 [labelType="html" label="MapPartitionsRDD [24655] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56268 { label="AQEShuffleRead"; 24656 [labelType="html" label="ShuffledRowRDD [24656] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56267 { label="ObjectHashAggregate"; 24657 [labelType="html" label="MapPartitionsRDD [24657] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56263 { label="WholeStageCodegen (15)"; 24658 [labelType="html" label="MapPartitionsRDD [24658] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56250 { label="WholeStageCodegen (16)"; 24659 [labelType="html" label="ZippedPartitionsRDD2 [24659] [Unordered]<br>count at ColumnStatJob.java:47"]; 24660 [labelType="html" label="MapPartitionsRDD [24660] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56239 { label="Union"; 24661 [labelType="html" label="UnionRDD [24661] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56273 { label="Scan csv "; 24662 [labelType="html" label="FileScanRDD [24662]<br>count at ColumnStatJob.java:47"]; 24663 [labelType="html" label="MapPartitionsRDD [24663]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56269 { label="WholeStageCodegen (17)"; 24664 [labelType="html" label="MapPartitionsRDD [24664]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56238 { label="CartesianProduct"; 24665 [labelType="html" label="UnsafeCartesianRDD [24665] [Unordered]<br>count at ColumnStatJob.java:47"]; 24666 [labelType="html" label="MapPartitionsRDD [24666] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster56237 { label="Exchange"; 24667 [labelType="html" label="MapPartitionsRDD [24667] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 24650->24651; 24651->24652; 24652->24653; 24654->24655; 24656->24657; 24657->24658; 24655->24659; 24658->24659; 24659->24660; 24653->24661; 24660->24661; 24662->24663; 24663->24664; 24661->24665; 24664->24665; 24665->24666; 24666->24667; }
24649,24650
24632,24654
24642,24656
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time