3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 17344 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
4.8 KiB / 499
Associated Job Ids:
9187
DAG Visualization
digraph G { subgraph clusterstage_17344 { label="Stage 17344"; subgraph cluster112812 { label="Scan parquet "; 47960 [labelType="html" label="FileScanRDD [47960]<br>count at ColumnStatJob.java:47"]; 47961 [labelType="html" label="MapPartitionsRDD [47961]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112807 { label="WholeStageCodegen (13)"; 47962 [labelType="html" label="MapPartitionsRDD [47962]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112818 { label="Scan parquet "; 47963 [labelType="html" label="FileScanRDD [47963]<br>count at ColumnStatJob.java:47"]; 47964 [labelType="html" label="MapPartitionsRDD [47964]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112813 { label="WholeStageCodegen (14)"; 47965 [labelType="html" label="MapPartitionsRDD [47965]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112824 { label="Scan parquet "; 47966 [labelType="html" label="FileScanRDD [47966]<br>count at ColumnStatJob.java:47"]; 47967 [labelType="html" label="MapPartitionsRDD [47967]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112819 { label="WholeStageCodegen (15)"; 47968 [labelType="html" label="MapPartitionsRDD [47968]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112806 { label="Union"; 47969 [labelType="html" label="UnionRDD [47969]<br>count at ColumnStatJob.java:47"]; } subgraph cluster112805 { label="Exchange"; 47970 [labelType="html" label="MapPartitionsRDD [47970]<br>count at ColumnStatJob.java:47"]; } } 47960->47961; 47961->47962; 47963->47964; 47964->47965; 47966->47967; 47967->47968; 47962->47969; 47965->47969; 47968->47969; 47969->47970; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time