3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15842 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Any: 10
Input Size / Records:
92.4 MiB / 2231133
Shuffle Read Size / Records:
460.0 B / 10
Shuffle Write Size / Records:
8.5 MiB / 256548
Associated Job Ids:
8011
DAG Visualization
digraph G { subgraph clusterstage_15842 { label="Stage 15842"; subgraph cluster103580 { label="Scan parquet "; 44400 [labelType="html" label="FileScanRDD [44400]<br>parquet at PersistJob.java:35"]; 44401 [labelType="html" label="MapPartitionsRDD [44401]<br>parquet at PersistJob.java:35"]; } subgraph cluster103575 { label="WholeStageCodegen (46)"; 44402 [labelType="html" label="MapPartitionsRDD [44402]<br>parquet at PersistJob.java:35"]; } subgraph cluster103585 { label="Scan csv "; 44403 [labelType="html" label="FileScanRDD [44403]<br>parquet at PersistJob.java:35"]; 44404 [labelType="html" label="MapPartitionsRDD [44404]<br>parquet at PersistJob.java:35"]; } subgraph cluster103581 { label="WholeStageCodegen (47)"; 44405 [labelType="html" label="MapPartitionsRDD [44405]<br>parquet at PersistJob.java:35"]; } subgraph cluster103574 { label="CartesianProduct"; 44406 [labelType="html" label="UnsafeCartesianRDD [44406]<br>parquet at PersistJob.java:35"]; 44407 [labelType="html" label="MapPartitionsRDD [44407]<br>parquet at PersistJob.java:35"]; } subgraph cluster103571 { label="WholeStageCodegen (48)"; 44408 [labelType="html" label="MapPartitionsRDD [44408]<br>parquet at PersistJob.java:35"]; } subgraph cluster103590 { label="Exchange"; 44409 [labelType="html" label="ShuffledRowRDD [44409] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103586 { label="WholeStageCodegen (49)"; 44410 [labelType="html" label="MapPartitionsRDD [44410] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103570 { label="CartesianProduct"; 44411 [labelType="html" label="UnsafeCartesianRDD [44411] [Unordered]<br>parquet at PersistJob.java:35"]; 44412 [labelType="html" label="MapPartitionsRDD [44412] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103567 { label="WholeStageCodegen (50)"; 44413 [labelType="html" label="MapPartitionsRDD [44413] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103566 { label="Exchange"; 44414 [labelType="html" label="MapPartitionsRDD [44414] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44400->44401; 44401->44402; 44403->44404; 44404->44405; 44402->44406; 44405->44406; 44406->44407; 44407->44408; 44409->44410; 44408->44411; 44410->44411; 44411->44412; 44412->44413; 44413->44414; }
44275,44409
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time