3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15070 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 10
Input Size / Records:
2.2 MiB / 34259
Output Size / Records:
1454.0 B / 0
Associated Job Ids:
7914
DAG Visualization
digraph G { subgraph clusterstage_15070 { label="Stage 15070"; subgraph cluster96709 { label="Scan parquet "; 40778 [labelType="html" label="FileScanRDD [40778]<br>parquet at PersistJob.java:35"]; 40779 [labelType="html" label="MapPartitionsRDD [40779]<br>parquet at PersistJob.java:35"]; } subgraph cluster96702 { label="WholeStageCodegen (1)"; 40780 [labelType="html" label="MapPartitionsRDD [40780]<br>parquet at PersistJob.java:35"]; } subgraph cluster96714 { label="Scan csv "; 40782 [labelType="html" label="FileScanRDD [40782]<br>parquet at PersistJob.java:35"]; 40784 [labelType="html" label="MapPartitionsRDD [40784]<br>parquet at PersistJob.java:35"]; } subgraph cluster96710 { label="WholeStageCodegen (2)"; 40786 [labelType="html" label="MapPartitionsRDD [40786]<br>parquet at PersistJob.java:35"]; } subgraph cluster96701 { label="CartesianProduct"; 40787 [labelType="html" label="UnsafeCartesianRDD [40787]<br>parquet at PersistJob.java:35"]; 40788 [labelType="html" label="MapPartitionsRDD [40788]<br>parquet at PersistJob.java:35"]; } subgraph cluster96695 { label="WholeStageCodegen (3)"; 40789 [labelType="html" label="MapPartitionsRDD [40789]<br>parquet at PersistJob.java:35"]; } subgraph cluster96694 { label="WriteFiles"; 40790 [labelType="html" label="MapPartitionsRDD [40790]<br>parquet at PersistJob.java:35"]; } } 40778->40779; 40779->40780; 40782->40784; 40784->40786; 40780->40787; 40786->40787; 40787->40788; 40788->40789; 40789->40790; }
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time