3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8622 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
26 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
98.2 MiB / 2132018
Shuffle Read Size / Records:
11.4 MiB / 262408
Associated Job Ids:
4259
DAG Visualization
digraph G { subgraph clusterstage_8622 { label="Stage 8622"; subgraph cluster56420 { label="Exchange"; 24731 [labelType="html" label="ShuffledRowRDD [24731] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56416 { label="WholeStageCodegen (18)"; 24732 [labelType="html" label="MapPartitionsRDD [24732] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56415 { label="Window"; 24733 [labelType="html" label="MapPartitionsRDD [24733] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56413 { label="Filter"; 24734 [labelType="html" label="MapPartitionsRDD [24734] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56412 { label="Project"; 24735 [labelType="html" label="MapPartitionsRDD [24735] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56411 { label="Project"; 24736 [labelType="html" label="MapPartitionsRDD [24736] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56410 { label="Project"; 24737 [labelType="html" label="MapPartitionsRDD [24737] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56409 { label="Project"; 24738 [labelType="html" label="MapPartitionsRDD [24738] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56408 { label="Project"; 24739 [labelType="html" label="MapPartitionsRDD [24739] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56426 { label="Scan parquet "; 24740 [labelType="html" label="FileScanRDD [24740]<br>takeAsList at DataFrameCommonJob.java:145"]; 24741 [labelType="html" label="MapPartitionsRDD [24741]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56421 { label="WholeStageCodegen (20)"; 24742 [labelType="html" label="MapPartitionsRDD [24742]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56399 { label="Union"; 24743 [labelType="html" label="UnionRDD [24743] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56398 { label="TakeOrderedAndProject"; 24744 [labelType="html" label="MapPartitionsRDD [24744] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 24745 [labelType="html" label="MapPartitionsRDD [24745] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24731->24732; 24732->24733; 24733->24734; 24734->24735; 24735->24736; 24736->24737; 24737->24738; 24738->24739; 24740->24741; 24741->24742; 24739->24743; 24742->24743; 24743->24744; 24744->24745; }
24730,24731
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time