3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8591 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259495
Shuffle Write Size / Records:
20.8 MiB / 259485
Associated Job Ids:
4251
DAG Visualization
digraph G { subgraph clusterstage_8591 { label="Stage 8591"; subgraph cluster56284 { label="Scan parquet "; 24668 [labelType="html" label="FileScanRDD [24668]<br>takeAsList at DataFrameCommonJob.java:145"]; 24669 [labelType="html" label="MapPartitionsRDD [24669]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56280 { label="WholeStageCodegen (1)"; 24670 [labelType="html" label="MapPartitionsRDD [24670]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56289 { label="Scan csv "; 24671 [labelType="html" label="FileScanRDD [24671]<br>takeAsList at DataFrameCommonJob.java:145"]; 24672 [labelType="html" label="MapPartitionsRDD [24672]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56285 { label="WholeStageCodegen (2)"; 24673 [labelType="html" label="MapPartitionsRDD [24673]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56279 { label="CartesianProduct"; 24674 [labelType="html" label="UnsafeCartesianRDD [24674]<br>takeAsList at DataFrameCommonJob.java:145"]; 24675 [labelType="html" label="MapPartitionsRDD [24675]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56275 { label="WholeStageCodegen (3)"; 24676 [labelType="html" label="MapPartitionsRDD [24676]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster56274 { label="Exchange"; 24677 [labelType="html" label="MapPartitionsRDD [24677]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 24668->24669; 24669->24670; 24671->24672; 24672->24673; 24670->24674; 24673->24674; 24674->24675; 24675->24676; 24676->24677; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time