3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18513 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
8 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.4 MiB / 358829
Shuffle Write Size / Records:
11.4 MiB / 262581
Associated Job Ids:
9262
DAG Visualization
digraph G { subgraph clusterstage_18513 { label="Stage 18513"; subgraph cluster120855 { label="Exchange"; 51851 [labelType="html" label="ShuffledRowRDD [51851] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120851 { label="WholeStageCodegen (12)"; 51852 [labelType="html" label="MapPartitionsRDD [51852] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120850 { label="Window"; 51853 [labelType="html" label="MapPartitionsRDD [51853] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120846 { label="WholeStageCodegen (13)"; 51854 [labelType="html" label="MapPartitionsRDD [51854] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120867 { label="AQEShuffleRead"; 51855 [labelType="html" label="ShuffledRowRDD [51855] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120864 { label="WholeStageCodegen (14)"; 51856 [labelType="html" label="MapPartitionsRDD [51856] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120874 { label="AQEShuffleRead"; 51857 [labelType="html" label="ShuffledRowRDD [51857] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120873 { label="ObjectHashAggregate"; 51858 [labelType="html" label="MapPartitionsRDD [51858] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120869 { label="WholeStageCodegen (15)"; 51859 [labelType="html" label="MapPartitionsRDD [51859] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120856 { label="WholeStageCodegen (16)"; 51860 [labelType="html" label="ZippedPartitionsRDD2 [51860] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51861 [labelType="html" label="MapPartitionsRDD [51861] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120845 { label="Union"; 51862 [labelType="html" label="UnionRDD [51862] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120879 { label="Scan csv "; 51863 [labelType="html" label="FileScanRDD [51863]<br>takeAsList at DataFrameCommonJob.java:145"]; 51864 [labelType="html" label="MapPartitionsRDD [51864]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120875 { label="WholeStageCodegen (17)"; 51865 [labelType="html" label="MapPartitionsRDD [51865]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120844 { label="CartesianProduct"; 51866 [labelType="html" label="UnsafeCartesianRDD [51866] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51867 [labelType="html" label="MapPartitionsRDD [51867] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster120843 { label="Exchange"; 51868 [labelType="html" label="MapPartitionsRDD [51868] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51851->51852; 51852->51853; 51853->51854; 51855->51856; 51857->51858; 51858->51859; 51856->51860; 51859->51860; 51860->51861; 51854->51862; 51861->51862; 51863->51864; 51864->51865; 51862->51866; 51865->51866; 51866->51867; 51867->51868; }
51838,51851
51815,51855
51825,51857
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time