3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17343 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
24 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 596043
Shuffle Read Size / Records:
8.3 MiB / 171879
Associated Job Ids:
8695
DAG Visualization
digraph G { subgraph clusterstage_17343 { label="Stage 17343"; subgraph cluster113158 { label="AQEShuffleRead"; 48612 [labelType="html" label="ShuffledRowRDD [48612] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113155 { label="WholeStageCodegen (18)"; 48613 [labelType="html" label="MapPartitionsRDD [48613] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113154 { label="Window"; 48614 [labelType="html" label="MapPartitionsRDD [48614] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113152 { label="Filter"; 48615 [labelType="html" label="MapPartitionsRDD [48615] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113151 { label="Project"; 48616 [labelType="html" label="MapPartitionsRDD [48616] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113150 { label="Project"; 48617 [labelType="html" label="MapPartitionsRDD [48617] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113149 { label="Project"; 48618 [labelType="html" label="MapPartitionsRDD [48618] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113148 { label="Project"; 48619 [labelType="html" label="MapPartitionsRDD [48619] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113147 { label="Project"; 48620 [labelType="html" label="MapPartitionsRDD [48620] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113164 { label="Scan parquet "; 48621 [labelType="html" label="FileScanRDD [48621]<br>takeAsList at DataFrameCommonJob.java:145"]; 48622 [labelType="html" label="MapPartitionsRDD [48622]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113159 { label="WholeStageCodegen (20)"; 48623 [labelType="html" label="MapPartitionsRDD [48623]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113127 { label="Union"; 48624 [labelType="html" label="UnionRDD [48624] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster113126 { label="TakeOrderedAndProject"; 48625 [labelType="html" label="MapPartitionsRDD [48625] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 48626 [labelType="html" label="MapPartitionsRDD [48626] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48612->48613; 48613->48614; 48614->48615; 48615->48616; 48616->48617; 48617->48618; 48618->48619; 48619->48620; 48621->48622; 48622->48623; 48620->48624; 48623->48624; 48624->48625; 48625->48626; }
48601,48612
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time