3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8614 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.4 MiB / 358608
Shuffle Write Size / Records:
11.4 MiB / 262408
Associated Job Ids:
4258
DAG Visualization
digraph G { subgraph clusterstage_8614 { label="Stage 8614"; subgraph cluster56373 { label="Exchange"; 24713 [labelType="html" label="ShuffledRowRDD [24713] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56369 { label="WholeStageCodegen (12)"; 24714 [labelType="html" label="MapPartitionsRDD [24714] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56368 { label="Window"; 24715 [labelType="html" label="MapPartitionsRDD [24715] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56364 { label="WholeStageCodegen (13)"; 24716 [labelType="html" label="MapPartitionsRDD [24716] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56385 { label="AQEShuffleRead"; 24717 [labelType="html" label="ShuffledRowRDD [24717] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56382 { label="WholeStageCodegen (14)"; 24718 [labelType="html" label="MapPartitionsRDD [24718] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56392 { label="AQEShuffleRead"; 24719 [labelType="html" label="ShuffledRowRDD [24719] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56391 { label="ObjectHashAggregate"; 24720 [labelType="html" label="MapPartitionsRDD [24720] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56387 { label="WholeStageCodegen (15)"; 24721 [labelType="html" label="MapPartitionsRDD [24721] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56374 { label="WholeStageCodegen (16)"; 24722 [labelType="html" label="ZippedPartitionsRDD2 [24722] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24723 [labelType="html" label="MapPartitionsRDD [24723] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56363 { label="Union"; 24724 [labelType="html" label="UnionRDD [24724] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56397 { label="Scan csv "; 24725 [labelType="html" label="FileScanRDD [24725]<br>takeAsList at DataFrameCommonJob.java:145"]; 24726 [labelType="html" label="MapPartitionsRDD [24726]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56393 { label="WholeStageCodegen (17)"; 24727 [labelType="html" label="MapPartitionsRDD [24727]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56362 { label="CartesianProduct"; 24728 [labelType="html" label="UnsafeCartesianRDD [24728] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24729 [labelType="html" label="MapPartitionsRDD [24729] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56361 { label="Exchange"; 24730 [labelType="html" label="MapPartitionsRDD [24730] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24713->24714; 24714->24715; 24715->24716; 24717->24718; 24719->24720; 24720->24721; 24718->24722; 24721->24722; 24722->24723; 24716->24724; 24723->24724; 24725->24726; 24726->24727; 24724->24728; 24727->24728; 24728->24729; 24729->24730; }
24702,24713
24685,24717
24695,24719
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time