3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15071 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 5
Input Size / Records:
1427.5 KiB / 85900
Shuffle Write Size / Records:
790.5 KiB / 37268
Associated Job Ids:
7915
DAG Visualization
digraph G { subgraph clusterstage_15071 { label="Stage 15071"; subgraph cluster96726 { label="Scan parquet "; 40781 [labelType="html" label="FileScanRDD [40781]<br>parquet at PersistJob.java:35"]; 40783 [labelType="html" label="MapPartitionsRDD [40783]<br>parquet at PersistJob.java:35"]; } subgraph cluster96721 { label="WholeStageCodegen (1)"; 40785 [labelType="html" label="MapPartitionsRDD [40785]<br>parquet at PersistJob.java:35"]; } subgraph cluster96731 { label="Scan csv "; 40791 [labelType="html" label="FileScanRDD [40791]<br>parquet at PersistJob.java:35"]; 40792 [labelType="html" label="MapPartitionsRDD [40792]<br>parquet at PersistJob.java:35"]; } subgraph cluster96727 { label="WholeStageCodegen (2)"; 40793 [labelType="html" label="MapPartitionsRDD [40793]<br>parquet at PersistJob.java:35"]; } subgraph cluster96720 { label="CartesianProduct"; 40794 [labelType="html" label="UnsafeCartesianRDD [40794]<br>parquet at PersistJob.java:35"]; 40795 [labelType="html" label="MapPartitionsRDD [40795]<br>parquet at PersistJob.java:35"]; } subgraph cluster96717 { label="WholeStageCodegen (3)"; 40796 [labelType="html" label="MapPartitionsRDD [40796]<br>parquet at PersistJob.java:35"]; } subgraph cluster96716 { label="ObjectHashAggregate"; 40797 [labelType="html" label="MapPartitionsRDD [40797]<br>parquet at PersistJob.java:35"]; } subgraph cluster96715 { label="Exchange"; 40798 [labelType="html" label="MapPartitionsRDD [40798]<br>parquet at PersistJob.java:35"]; } } 40781->40783; 40783->40785; 40791->40792; 40792->40793; 40785->40794; 40793->40794; 40794->40795; 40795->40796; 40796->40797; 40797->40798; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time