3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6364 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
52 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.1 KiB / 533
Shuffle Write Size / Records:
7.9 KiB / 532
Associated Job Ids:
3387
DAG Visualization
digraph G { subgraph clusterstage_6364 { label="Stage 6364"; subgraph cluster42741 { label="Scan parquet "; 18447 [labelType="html" label="FileScanRDD [18447]<br>count at ColumnStatJob.java:47"]; 18448 [labelType="html" label="MapPartitionsRDD [18448]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42736 { label="WholeStageCodegen (13)"; 18449 [labelType="html" label="MapPartitionsRDD [18449]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42747 { label="Scan parquet "; 18450 [labelType="html" label="FileScanRDD [18450]<br>count at ColumnStatJob.java:47"]; 18451 [labelType="html" label="MapPartitionsRDD [18451]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42742 { label="WholeStageCodegen (14)"; 18452 [labelType="html" label="MapPartitionsRDD [18452]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42753 { label="Scan parquet "; 18453 [labelType="html" label="FileScanRDD [18453]<br>count at ColumnStatJob.java:47"]; 18454 [labelType="html" label="MapPartitionsRDD [18454]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42748 { label="WholeStageCodegen (15)"; 18455 [labelType="html" label="MapPartitionsRDD [18455]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42735 { label="Union"; 18456 [labelType="html" label="UnionRDD [18456]<br>count at ColumnStatJob.java:47"]; } subgraph cluster42734 { label="Exchange"; 18457 [labelType="html" label="MapPartitionsRDD [18457]<br>count at ColumnStatJob.java:47"]; } } 18447->18448; 18448->18449; 18450->18451; 18451->18452; 18453->18454; 18454->18455; 18449->18456; 18452->18456; 18455->18456; 18456->18457; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time