3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 13593 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Any: 1
Input Size / Records:
110.0 B / 1
Shuffle Read Size / Records:
1737.3 KiB / 48729
Shuffle Write Size / Records:
1433.7 KiB / 21885
Associated Job Ids:
6812
DAG Visualization
digraph G { subgraph clusterstage_13593 { label="Stage 13593"; subgraph cluster88521 { label="AQEShuffleRead"; 37681 [labelType="html" label="ShuffledRowRDD [37681] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88518 { label="WholeStageCodegen (60)"; 37682 [labelType="html" label="MapPartitionsRDD [37682] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88517 { label="Window"; 37683 [labelType="html" label="MapPartitionsRDD [37683] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88511 { label="WholeStageCodegen (61)"; 37684 [labelType="html" label="MapPartitionsRDD [37684] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88526 { label="Scan csv "; 37685 [labelType="html" label="FileScanRDD [37685]<br>rdd at PersistJob.java:28"]; 37686 [labelType="html" label="MapPartitionsRDD [37686]<br>rdd at PersistJob.java:28"]; } subgraph cluster88522 { label="WholeStageCodegen (62)"; 37687 [labelType="html" label="MapPartitionsRDD [37687]<br>rdd at PersistJob.java:28"]; } subgraph cluster88510 { label="CartesianProduct"; 37688 [labelType="html" label="UnsafeCartesianRDD [37688] [Unordered]<br>rdd at PersistJob.java:28"]; 37689 [labelType="html" label="MapPartitionsRDD [37689] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster88509 { label="Exchange"; 37690 [labelType="html" label="MapPartitionsRDD [37690] [Unordered]<br>rdd at PersistJob.java:28"]; } } 37681->37682; 37682->37683; 37683->37684; 37685->37686; 37686->37687; 37684->37688; 37687->37688; 37688->37689; 37689->37690; }
37680,37681
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time