3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8933 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
59 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
12.6 KiB / 367
Associated Job Ids:
4509
DAG Visualization
digraph G { subgraph clusterstage_8933 { label="Stage 8933"; subgraph cluster58595 { label="Scan parquet "; 25585 [labelType="html" label="FileScanRDD [25585]<br>takeAsList at DataFrameCommonJob.java:145"]; 25586 [labelType="html" label="MapPartitionsRDD [25586]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58590 { label="WholeStageCodegen (1)"; 25587 [labelType="html" label="MapPartitionsRDD [25587]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58601 { label="Scan parquet "; 25588 [labelType="html" label="FileScanRDD [25588]<br>takeAsList at DataFrameCommonJob.java:145"]; 25589 [labelType="html" label="MapPartitionsRDD [25589]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58596 { label="WholeStageCodegen (2)"; 25590 [labelType="html" label="MapPartitionsRDD [25590]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58607 { label="Scan parquet "; 25591 [labelType="html" label="FileScanRDD [25591]<br>takeAsList at DataFrameCommonJob.java:145"]; 25592 [labelType="html" label="MapPartitionsRDD [25592]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58602 { label="WholeStageCodegen (3)"; 25593 [labelType="html" label="MapPartitionsRDD [25593]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58589 { label="Union"; 25594 [labelType="html" label="UnionRDD [25594]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster58608 { label="mapPartitionsInternal"; 25595 [labelType="html" label="MapPartitionsRDD [25595]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 25585->25586; 25586->25587; 25588->25589; 25589->25590; 25591->25592; 25592->25593; 25587->25594; 25590->25594; 25593->25594; 25594->25595; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time