3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16998 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.6 KiB / 500
Shuffle Write Size / Records:
3.8 KiB / 177
Associated Job Ids:
8281
DAG Visualization
digraph G { subgraph clusterstage_16998 { label="Stage 16998"; subgraph cluster108962 { label="AQEShuffleRead"; 46600 [labelType="html" label="ShuffledRowRDD [46600] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108959 { label="WholeStageCodegen (17)"; 46601 [labelType="html" label="MapPartitionsRDD [46601] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108967 { label="AQEShuffleRead"; 46602 [labelType="html" label="ShuffledRowRDD [46602] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108964 { label="WholeStageCodegen (18)"; 46603 [labelType="html" label="MapPartitionsRDD [46603] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108955 { label="WholeStageCodegen (19)"; 46604 [labelType="html" label="ZippedPartitionsRDD2 [46604] [Unordered]<br>parquet at PersistJob.java:35"]; 46605 [labelType="html" label="MapPartitionsRDD [46605] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108972 { label="Scan csv "; 46606 [labelType="html" label="FileScanRDD [46606]<br>parquet at PersistJob.java:35"]; 46607 [labelType="html" label="MapPartitionsRDD [46607]<br>parquet at PersistJob.java:35"]; } subgraph cluster108968 { label="WholeStageCodegen (20)"; 46608 [labelType="html" label="MapPartitionsRDD [46608]<br>parquet at PersistJob.java:35"]; } subgraph cluster108954 { label="CartesianProduct"; 46609 [labelType="html" label="UnsafeCartesianRDD [46609] [Unordered]<br>parquet at PersistJob.java:35"]; 46610 [labelType="html" label="MapPartitionsRDD [46610] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108951 { label="WholeStageCodegen (21)"; 46611 [labelType="html" label="MapPartitionsRDD [46611] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster108950 { label="Exchange"; 46612 [labelType="html" label="MapPartitionsRDD [46612] [Unordered]<br>parquet at PersistJob.java:35"]; } } 46600->46601; 46602->46603; 46601->46604; 46603->46604; 46604->46605; 46606->46607; 46607->46608; 46605->46609; 46608->46609; 46609->46610; 46610->46611; 46611->46612; }
46595,46600
46599,46602
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time