3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44505 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
23596
DAG Visualization
digraph G { subgraph clusterstage_44505 { label="Stage 44505"; subgraph cluster306618 { label="Scan parquet "; 134384 [labelType="html" label="FileScanRDD [134384]<br>count at ColumnStatJob.java:47"]; 134385 [labelType="html" label="MapPartitionsRDD [134385]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306607 { label="WholeStageCodegen (13)"; 134386 [labelType="html" label="MapPartitionsRDD [134386]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306630 { label="Scan parquet "; 134390 [labelType="html" label="FileScanRDD [134390]<br>count at ColumnStatJob.java:47"]; 134391 [labelType="html" label="MapPartitionsRDD [134391]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306620 { label="WholeStageCodegen (14)"; 134392 [labelType="html" label="MapPartitionsRDD [134392]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306645 { label="Scan parquet "; 134399 [labelType="html" label="FileScanRDD [134399]<br>count at ColumnStatJob.java:47"]; 134400 [labelType="html" label="MapPartitionsRDD [134400]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306633 { label="WholeStageCodegen (15)"; 134401 [labelType="html" label="MapPartitionsRDD [134401]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306606 { label="Union"; 134402 [labelType="html" label="UnionRDD [134402]<br>count at ColumnStatJob.java:47"]; } subgraph cluster306605 { label="Exchange"; 134403 [labelType="html" label="MapPartitionsRDD [134403]<br>count at ColumnStatJob.java:47"]; } } 134384->134385; 134385->134386; 134390->134391; 134391->134392; 134399->134400; 134400->134401; 134386->134402; 134392->134402; 134401->134402; 134402->134403; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time