3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15219 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
22 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.6 KiB / 500
Shuffle Write Size / Records:
3.8 KiB / 177
Associated Job Ids:
8017
DAG Visualization
digraph G { subgraph clusterstage_15219 { label="Stage 15219"; subgraph cluster98378 { label="AQEShuffleRead"; 41573 [labelType="html" label="ShuffledRowRDD [41573] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98375 { label="WholeStageCodegen (17)"; 41574 [labelType="html" label="MapPartitionsRDD [41574] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98383 { label="AQEShuffleRead"; 41575 [labelType="html" label="ShuffledRowRDD [41575] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98380 { label="WholeStageCodegen (18)"; 41576 [labelType="html" label="MapPartitionsRDD [41576] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98371 { label="WholeStageCodegen (19)"; 41577 [labelType="html" label="ZippedPartitionsRDD2 [41577] [Unordered]<br>parquet at PersistJob.java:35"]; 41578 [labelType="html" label="MapPartitionsRDD [41578] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98388 { label="Scan csv "; 41579 [labelType="html" label="FileScanRDD [41579]<br>parquet at PersistJob.java:35"]; 41580 [labelType="html" label="MapPartitionsRDD [41580]<br>parquet at PersistJob.java:35"]; } subgraph cluster98384 { label="WholeStageCodegen (20)"; 41581 [labelType="html" label="MapPartitionsRDD [41581]<br>parquet at PersistJob.java:35"]; } subgraph cluster98370 { label="CartesianProduct"; 41582 [labelType="html" label="UnsafeCartesianRDD [41582] [Unordered]<br>parquet at PersistJob.java:35"]; 41583 [labelType="html" label="MapPartitionsRDD [41583] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98367 { label="WholeStageCodegen (21)"; 41584 [labelType="html" label="MapPartitionsRDD [41584] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster98366 { label="Exchange"; 41585 [labelType="html" label="MapPartitionsRDD [41585] [Unordered]<br>parquet at PersistJob.java:35"]; } } 41573->41574; 41575->41576; 41574->41577; 41576->41577; 41577->41578; 41579->41580; 41580->41581; 41578->41582; 41581->41582; 41582->41583; 41583->41584; 41584->41585; }
41568,41573
41572,41575
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time