3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6316 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
50 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
3349
DAG Visualization
digraph G { subgraph clusterstage_6316 { label="Stage 6316"; subgraph cluster42366 { label="Scan parquet "; 18257 [labelType="html" label="FileScanRDD [18257]<br>takeAsList at DataFrameCommonJob.java:145"]; 18258 [labelType="html" label="MapPartitionsRDD [18258]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42361 { label="WholeStageCodegen (13)"; 18259 [labelType="html" label="MapPartitionsRDD [18259]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42372 { label="Scan parquet "; 18260 [labelType="html" label="FileScanRDD [18260]<br>takeAsList at DataFrameCommonJob.java:145"]; 18261 [labelType="html" label="MapPartitionsRDD [18261]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42367 { label="WholeStageCodegen (14)"; 18262 [labelType="html" label="MapPartitionsRDD [18262]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42378 { label="Scan parquet "; 18263 [labelType="html" label="FileScanRDD [18263]<br>takeAsList at DataFrameCommonJob.java:145"]; 18264 [labelType="html" label="MapPartitionsRDD [18264]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42373 { label="WholeStageCodegen (15)"; 18265 [labelType="html" label="MapPartitionsRDD [18265]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42360 { label="Union"; 18266 [labelType="html" label="UnionRDD [18266]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster42359 { label="Exchange"; 18267 [labelType="html" label="MapPartitionsRDD [18267]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 18257->18258; 18258->18259; 18260->18261; 18261->18262; 18263->18264; 18264->18265; 18259->18266; 18262->18266; 18265->18266; 18266->18267; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time