3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8943 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 3
Input Size / Records:
26.4 KiB / 533
Shuffle Write Size / Records:
364.0 B / 5
Associated Job Ids:
4518
DAG Visualization
digraph G { subgraph clusterstage_8943 { label="Stage 8943"; subgraph cluster58699 { label="Scan parquet "; 25623 [labelType="html" label="FileScanRDD [25623]<br>takeAsList at DataFrameCommonJob.java:145"]; 25624 [labelType="html" label="MapPartitionsRDD [25624]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58694 { label="WholeStageCodegen (1)"; 25625 [labelType="html" label="MapPartitionsRDD [25625]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58705 { label="Scan parquet "; 25626 [labelType="html" label="FileScanRDD [25626]<br>takeAsList at DataFrameCommonJob.java:145"]; 25627 [labelType="html" label="MapPartitionsRDD [25627]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58700 { label="WholeStageCodegen (2)"; 25628 [labelType="html" label="MapPartitionsRDD [25628]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58711 { label="Scan parquet "; 25629 [labelType="html" label="FileScanRDD [25629]<br>takeAsList at DataFrameCommonJob.java:145"]; 25630 [labelType="html" label="MapPartitionsRDD [25630]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58706 { label="WholeStageCodegen (3)"; 25631 [labelType="html" label="MapPartitionsRDD [25631]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58693 { label="Union"; 25632 [labelType="html" label="UnionRDD [25632]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58690 { label="WholeStageCodegen (4)"; 25633 [labelType="html" label="MapPartitionsRDD [25633]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58689 { label="Exchange"; 25634 [labelType="html" label="MapPartitionsRDD [25634]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 25623->25624; 25624->25625; 25626->25627; 25627->25628; 25629->25630; 25630->25631; 25625->25632; 25628->25632; 25631->25632; 25632->25633; 25633->25634; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time