3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17352 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.5 KiB / 499
Associated Job Ids:
9192
DAG Visualization
digraph G { subgraph clusterstage_17352 { label="Stage 17352"; subgraph cluster112965 { label="Scan parquet "; 48030 [labelType="html" label="FileScanRDD [48030]<br>takeAsList at DataFrameCommonJob.java:145"]; 48031 [labelType="html" label="MapPartitionsRDD [48031]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112960 { label="WholeStageCodegen (13)"; 48032 [labelType="html" label="MapPartitionsRDD [48032]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112971 { label="Scan parquet "; 48033 [labelType="html" label="FileScanRDD [48033]<br>takeAsList at DataFrameCommonJob.java:145"]; 48034 [labelType="html" label="MapPartitionsRDD [48034]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112966 { label="WholeStageCodegen (14)"; 48035 [labelType="html" label="MapPartitionsRDD [48035]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112977 { label="Scan parquet "; 48036 [labelType="html" label="FileScanRDD [48036]<br>takeAsList at DataFrameCommonJob.java:145"]; 48037 [labelType="html" label="MapPartitionsRDD [48037]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112972 { label="WholeStageCodegen (15)"; 48038 [labelType="html" label="MapPartitionsRDD [48038]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112959 { label="Union"; 48039 [labelType="html" label="UnionRDD [48039]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster112958 { label="Exchange"; 48040 [labelType="html" label="MapPartitionsRDD [48040]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 48030->48031; 48031->48032; 48033->48034; 48034->48035; 48036->48037; 48037->48038; 48032->48039; 48035->48039; 48038->48039; 48039->48040; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time