3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44568 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
15.4 MiB / 350145
Shuffle Write Size / Records:
24.9 MiB / 299977
Associated Job Ids:
23626
DAG Visualization
digraph G { subgraph clusterstage_44568 { label="Stage 44568"; subgraph cluster307203 { label="Scan parquet "; 134601 [labelType="html" label="FileScanRDD [134601]<br>takeAsList at DataFrameCommonJob.java:145"]; 134602 [labelType="html" label="MapPartitionsRDD [134602]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307198 { label="WholeStageCodegen (1)"; 134603 [labelType="html" label="MapPartitionsRDD [134603]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307208 { label="Scan csv "; 134604 [labelType="html" label="FileScanRDD [134604]<br>takeAsList at DataFrameCommonJob.java:145"]; 134605 [labelType="html" label="MapPartitionsRDD [134605]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307204 { label="WholeStageCodegen (2)"; 134606 [labelType="html" label="MapPartitionsRDD [134606]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307197 { label="CartesianProduct"; 134607 [labelType="html" label="UnsafeCartesianRDD [134607]<br>takeAsList at DataFrameCommonJob.java:145"]; 134608 [labelType="html" label="MapPartitionsRDD [134608]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307193 { label="WholeStageCodegen (3)"; 134609 [labelType="html" label="MapPartitionsRDD [134609]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster307192 { label="Exchange"; 134610 [labelType="html" label="MapPartitionsRDD [134610]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 134601->134602; 134602->134603; 134604->134605; 134605->134606; 134603->134607; 134606->134607; 134607->134608; 134608->134609; 134609->134610; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time