3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44508 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
44 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
23599
DAG Visualization
digraph G { subgraph clusterstage_44508 { label="Stage 44508"; subgraph cluster306714 { label="Scan parquet "; 134435 [labelType="html" label="FileScanRDD [134435]<br>takeAsList at DataFrameCommonJob.java:145"]; 134436 [labelType="html" label="MapPartitionsRDD [134436]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306709 { label="WholeStageCodegen (13)"; 134437 [labelType="html" label="MapPartitionsRDD [134437]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306720 { label="Scan parquet "; 134438 [labelType="html" label="FileScanRDD [134438]<br>takeAsList at DataFrameCommonJob.java:145"]; 134439 [labelType="html" label="MapPartitionsRDD [134439]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306715 { label="WholeStageCodegen (14)"; 134440 [labelType="html" label="MapPartitionsRDD [134440]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306726 { label="Scan parquet "; 134441 [labelType="html" label="FileScanRDD [134441]<br>takeAsList at DataFrameCommonJob.java:145"]; 134442 [labelType="html" label="MapPartitionsRDD [134442]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306721 { label="WholeStageCodegen (15)"; 134443 [labelType="html" label="MapPartitionsRDD [134443]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306708 { label="Union"; 134444 [labelType="html" label="UnionRDD [134444]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster306707 { label="Exchange"; 134445 [labelType="html" label="MapPartitionsRDD [134445]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134435->134436; 134436->134437; 134438->134439; 134439->134440; 134441->134442; 134442->134443; 134437->134444; 134440->134444; 134443->134444; 134444->134445; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time