3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 7977 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 10
Input Size / Records:
14.6 MiB / 259495
Shuffle Write Size / Records:
20.8 MiB / 259485
Associated Job Ids:
3893
DAG Visualization
digraph G { subgraph clusterstage_7977 { label="Stage 7977"; subgraph cluster52138 { label="Scan parquet "; 23001 [labelType="html" label="FileScanRDD [23001]<br>parquet at PersistJob.java:35"]; 23002 [labelType="html" label="MapPartitionsRDD [23002]<br>parquet at PersistJob.java:35"]; } subgraph cluster52134 { label="WholeStageCodegen (1)"; 23003 [labelType="html" label="MapPartitionsRDD [23003]<br>parquet at PersistJob.java:35"]; } subgraph cluster52143 { label="Scan csv "; 23004 [labelType="html" label="FileScanRDD [23004]<br>parquet at PersistJob.java:35"]; 23005 [labelType="html" label="MapPartitionsRDD [23005]<br>parquet at PersistJob.java:35"]; } subgraph cluster52139 { label="WholeStageCodegen (2)"; 23006 [labelType="html" label="MapPartitionsRDD [23006]<br>parquet at PersistJob.java:35"]; } subgraph cluster52133 { label="CartesianProduct"; 23007 [labelType="html" label="UnsafeCartesianRDD [23007]<br>parquet at PersistJob.java:35"]; 23008 [labelType="html" label="MapPartitionsRDD [23008]<br>parquet at PersistJob.java:35"]; } subgraph cluster52129 { label="WholeStageCodegen (3)"; 23009 [labelType="html" label="MapPartitionsRDD [23009]<br>parquet at PersistJob.java:35"]; } subgraph cluster52128 { label="Exchange"; 23010 [labelType="html" label="MapPartitionsRDD [23010]<br>parquet at PersistJob.java:35"]; } } 23001->23002; 23002->23003; 23004->23005; 23005->23006; 23003->23007; 23006->23007; 23007->23008; 23008->23009; 23009->23010; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time