3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17259 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 15
Input Size / Records:
2.6 KiB / 15
Shuffle Read Size / Records:
26.2 MiB / 357035
Shuffle Write Size / Records:
11.4 MiB / 261221
Associated Job Ids:
8403
DAG Visualization
digraph G { subgraph clusterstage_17259 { label="Stage 17259"; subgraph cluster110624 { label="Exchange"; 47259 [labelType="html" label="ShuffledRowRDD [47259] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110620 { label="WholeStageCodegen (12)"; 47260 [labelType="html" label="MapPartitionsRDD [47260] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110619 { label="Window"; 47261 [labelType="html" label="MapPartitionsRDD [47261] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110615 { label="WholeStageCodegen (13)"; 47262 [labelType="html" label="MapPartitionsRDD [47262] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110636 { label="AQEShuffleRead"; 47263 [labelType="html" label="ShuffledRowRDD [47263] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110633 { label="WholeStageCodegen (14)"; 47264 [labelType="html" label="MapPartitionsRDD [47264] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110643 { label="AQEShuffleRead"; 47265 [labelType="html" label="ShuffledRowRDD [47265] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110642 { label="ObjectHashAggregate"; 47266 [labelType="html" label="MapPartitionsRDD [47266] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110638 { label="WholeStageCodegen (15)"; 47267 [labelType="html" label="MapPartitionsRDD [47267] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110625 { label="WholeStageCodegen (16)"; 47268 [labelType="html" label="ZippedPartitionsRDD2 [47268] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 47269 [labelType="html" label="MapPartitionsRDD [47269] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110614 { label="Union"; 47270 [labelType="html" label="UnionRDD [47270] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110648 { label="Scan csv "; 47271 [labelType="html" label="FileScanRDD [47271]<br>takeAsList at DataFrameCommonJob.java:145"]; 47272 [labelType="html" label="MapPartitionsRDD [47272]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110644 { label="WholeStageCodegen (17)"; 47273 [labelType="html" label="MapPartitionsRDD [47273]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110613 { label="CartesianProduct"; 47274 [labelType="html" label="UnsafeCartesianRDD [47274] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 47275 [labelType="html" label="MapPartitionsRDD [47275] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster110612 { label="Exchange"; 47276 [labelType="html" label="MapPartitionsRDD [47276] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 47259->47260; 47260->47261; 47261->47262; 47263->47264; 47265->47266; 47266->47267; 47264->47268; 47267->47268; 47268->47269; 47262->47270; 47269->47270; 47271->47272; 47272->47273; 47270->47274; 47273->47274; 47274->47275; 47275->47276; }
47240,47259
47223,47263
47252,47265
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time