3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 18338 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
13.6 MiB / 259668
Shuffle Write Size / Records:
18.8 MiB / 259658
Associated Job Ids:
9187
DAG Visualization
digraph G { subgraph clusterstage_18338 { label="Stage 18338"; subgraph cluster119648 { label="Scan parquet "; 51368 [labelType="html" label="FileScanRDD [51368]<br>count at ColumnStatJob.java:47"]; 51369 [labelType="html" label="MapPartitionsRDD [51369]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119644 { label="WholeStageCodegen (1)"; 51370 [labelType="html" label="MapPartitionsRDD [51370]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119653 { label="Scan csv "; 51371 [labelType="html" label="FileScanRDD [51371]<br>count at ColumnStatJob.java:47"]; 51372 [labelType="html" label="MapPartitionsRDD [51372]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119649 { label="WholeStageCodegen (2)"; 51373 [labelType="html" label="MapPartitionsRDD [51373]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119643 { label="CartesianProduct"; 51374 [labelType="html" label="UnsafeCartesianRDD [51374]<br>count at ColumnStatJob.java:47"]; 51375 [labelType="html" label="MapPartitionsRDD [51375]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119639 { label="WholeStageCodegen (3)"; 51376 [labelType="html" label="MapPartitionsRDD [51376]<br>count at ColumnStatJob.java:47"]; } subgraph cluster119638 { label="Exchange"; 51377 [labelType="html" label="MapPartitionsRDD [51377]<br>count at ColumnStatJob.java:47"]; } } 51368->51369; 51369->51370; 51371->51372; 51372->51373; 51370->51374; 51373->51374; 51374->51375; 51375->51376; 51376->51377; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time