3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18377 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.4 MiB / 358829
Shuffle Write Size / Records:
11.4 MiB / 262581
Associated Job Ids:
9201
DAG Visualization
digraph G { subgraph clusterstage_18377 { label="Stage 18377"; subgraph cluster119840 { label="Exchange"; 51466 [labelType="html" label="ShuffledRowRDD [51466] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119836 { label="WholeStageCodegen (12)"; 51467 [labelType="html" label="MapPartitionsRDD [51467] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119835 { label="Window"; 51468 [labelType="html" label="MapPartitionsRDD [51468] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119831 { label="WholeStageCodegen (13)"; 51469 [labelType="html" label="MapPartitionsRDD [51469] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119852 { label="AQEShuffleRead"; 51470 [labelType="html" label="ShuffledRowRDD [51470] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119849 { label="WholeStageCodegen (14)"; 51471 [labelType="html" label="MapPartitionsRDD [51471] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119859 { label="AQEShuffleRead"; 51472 [labelType="html" label="ShuffledRowRDD [51472] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119858 { label="ObjectHashAggregate"; 51473 [labelType="html" label="MapPartitionsRDD [51473] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119854 { label="WholeStageCodegen (15)"; 51474 [labelType="html" label="MapPartitionsRDD [51474] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119841 { label="WholeStageCodegen (16)"; 51475 [labelType="html" label="ZippedPartitionsRDD2 [51475] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51476 [labelType="html" label="MapPartitionsRDD [51476] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119830 { label="Union"; 51477 [labelType="html" label="UnionRDD [51477] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119864 { label="Scan csv "; 51478 [labelType="html" label="FileScanRDD [51478]<br>takeAsList at DataFrameCommonJob.java:145"]; 51479 [labelType="html" label="MapPartitionsRDD [51479]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119860 { label="WholeStageCodegen (17)"; 51480 [labelType="html" label="MapPartitionsRDD [51480]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119829 { label="CartesianProduct"; 51481 [labelType="html" label="UnsafeCartesianRDD [51481] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 51482 [labelType="html" label="MapPartitionsRDD [51482] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster119828 { label="Exchange"; 51483 [labelType="html" label="MapPartitionsRDD [51483] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 51466->51467; 51467->51468; 51468->51469; 51470->51471; 51472->51473; 51473->51474; 51471->51475; 51474->51475; 51475->51476; 51469->51477; 51476->51477; 51478->51479; 51479->51480; 51477->51481; 51480->51481; 51481->51482; 51482->51483; }
51455,51466
51438,51470
51448,51472
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time