3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5652 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1116.7 KiB / 493876
Shuffle Write Size / Records:
2.0 MiB / 493871
Associated Job Ids:
3041
DAG Visualization
digraph G { subgraph clusterstage_5652 { label="Stage 5652"; subgraph cluster35657 { label="Scan parquet "; 14786 [labelType="html" label="FileScanRDD [14786]<br>takeAsList at DataFrameCommonJob.java:143"]; 14787 [labelType="html" label="MapPartitionsRDD [14787]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35653 { label="WholeStageCodegen (1)"; 14788 [labelType="html" label="MapPartitionsRDD [14788]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35662 { label="Scan csv "; 14789 [labelType="html" label="FileScanRDD [14789]<br>takeAsList at DataFrameCommonJob.java:143"]; 14790 [labelType="html" label="MapPartitionsRDD [14790]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35658 { label="WholeStageCodegen (2)"; 14791 [labelType="html" label="MapPartitionsRDD [14791]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35652 { label="CartesianProduct"; 14792 [labelType="html" label="UnsafeCartesianRDD [14792]<br>takeAsList at DataFrameCommonJob.java:143"]; 14793 [labelType="html" label="MapPartitionsRDD [14793]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35649 { label="WholeStageCodegen (3)"; 14794 [labelType="html" label="MapPartitionsRDD [14794]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster35648 { label="Exchange"; 14795 [labelType="html" label="MapPartitionsRDD [14795]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 14786->14787; 14787->14788; 14789->14790; 14790->14791; 14788->14792; 14791->14792; 14792->14793; 14793->14794; 14794->14795; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time