3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 8075 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
51 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
35.4 KiB / 8
Shuffle Write Size / Records:
516.0 B / 7
Associated Job Ids:
3819
DAG Visualization
digraph G { subgraph clusterstage_8075 { label="Stage 8075"; subgraph cluster49866 { label="Scan parquet "; 21492 [labelType="html" label="FileScanRDD [21492]<br>takeAsList at DataFrameCommonJob.java:145"]; 21493 [labelType="html" label="MapPartitionsRDD [21493]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49861 { label="WholeStageCodegen (1)"; 21494 [labelType="html" label="MapPartitionsRDD [21494]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49871 { label="Scan csv "; 21495 [labelType="html" label="FileScanRDD [21495]<br>takeAsList at DataFrameCommonJob.java:145"]; 21496 [labelType="html" label="MapPartitionsRDD [21496]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49867 { label="WholeStageCodegen (2)"; 21497 [labelType="html" label="MapPartitionsRDD [21497]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49860 { label="CartesianProduct"; 21498 [labelType="html" label="UnsafeCartesianRDD [21498]<br>takeAsList at DataFrameCommonJob.java:145"]; 21499 [labelType="html" label="MapPartitionsRDD [21499]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49857 { label="WholeStageCodegen (3)"; 21500 [labelType="html" label="MapPartitionsRDD [21500]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster49856 { label="Exchange"; 21501 [labelType="html" label="MapPartitionsRDD [21501]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 21492->21493; 21493->21494; 21495->21496; 21496->21497; 21494->21498; 21497->21498; 21498->21499; 21499->21500; 21500->21501; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time