3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44968 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 10
Input Size / Records:
20.7 MiB / 350145
Shuffle Write Size / Records:
31.3 MiB / 350135
Associated Job Ids:
23858
DAG Visualization
digraph G { subgraph clusterstage_44968 { label="Stage 44968"; subgraph cluster310322 { label="Scan parquet "; 135862 [labelType="html" label="FileScanRDD [135862]<br>parquet at PersistJob.java:35"]; 135863 [labelType="html" label="MapPartitionsRDD [135863]<br>parquet at PersistJob.java:35"]; } subgraph cluster310318 { label="WholeStageCodegen (1)"; 135864 [labelType="html" label="MapPartitionsRDD [135864]<br>parquet at PersistJob.java:35"]; } subgraph cluster310327 { label="Scan csv "; 135865 [labelType="html" label="FileScanRDD [135865]<br>parquet at PersistJob.java:35"]; 135866 [labelType="html" label="MapPartitionsRDD [135866]<br>parquet at PersistJob.java:35"]; } subgraph cluster310323 { label="WholeStageCodegen (2)"; 135867 [labelType="html" label="MapPartitionsRDD [135867]<br>parquet at PersistJob.java:35"]; } subgraph cluster310317 { label="CartesianProduct"; 135868 [labelType="html" label="UnsafeCartesianRDD [135868]<br>parquet at PersistJob.java:35"]; 135869 [labelType="html" label="MapPartitionsRDD [135869]<br>parquet at PersistJob.java:35"]; } subgraph cluster310313 { label="WholeStageCodegen (3)"; 135870 [labelType="html" label="MapPartitionsRDD [135870]<br>parquet at PersistJob.java:35"]; } subgraph cluster310312 { label="Exchange"; 135871 [labelType="html" label="MapPartitionsRDD [135871]<br>parquet at PersistJob.java:35"]; } } 135862->135863; 135863->135864; 135865->135866; 135866->135867; 135864->135868; 135867->135868; 135868->135869; 135869->135870; 135870->135871; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time