3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15570 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Input Size / Records:
3.5 KiB / 1
Shuffle Read Size / Records:
892.3 KiB / 44963
Shuffle Write Size / Records:
685.5 KiB / 36518
Associated Job Ids:
7676
DAG Visualization
digraph G { subgraph clusterstage_15570 { label="Stage 15570"; subgraph cluster100001 { label="AQEShuffleRead"; 42673 [labelType="html" label="ShuffledRowRDD [42673] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99998 { label="WholeStageCodegen (9)"; 42674 [labelType="html" label="MapPartitionsRDD [42674] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99997 { label="Window"; 42675 [labelType="html" label="MapPartitionsRDD [42675] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99994 { label="WholeStageCodegen (10)"; 42676 [labelType="html" label="MapPartitionsRDD [42676] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99993 { label="Window"; 42677 [labelType="html" label="MapPartitionsRDD [42677] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99989 { label="WholeStageCodegen (11)"; 42678 [labelType="html" label="MapPartitionsRDD [42678] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster100006 { label="Scan parquet "; 42679 [labelType="html" label="FileScanRDD [42679]<br>rdd at PersistJob.java:28"]; 42680 [labelType="html" label="MapPartitionsRDD [42680]<br>rdd at PersistJob.java:28"]; } subgraph cluster100002 { label="WholeStageCodegen (12)"; 42681 [labelType="html" label="MapPartitionsRDD [42681]<br>rdd at PersistJob.java:28"]; } subgraph cluster99988 { label="CartesianProduct"; 42682 [labelType="html" label="UnsafeCartesianRDD [42682] [Unordered]<br>rdd at PersistJob.java:28"]; 42683 [labelType="html" label="MapPartitionsRDD [42683] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99985 { label="WholeStageCodegen (13)"; 42684 [labelType="html" label="MapPartitionsRDD [42684] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99984 { label="Exchange"; 42685 [labelType="html" label="MapPartitionsRDD [42685] [Unordered]<br>rdd at PersistJob.java:28"]; } } 42673->42674; 42674->42675; 42675->42676; 42676->42677; 42677->42678; 42679->42680; 42680->42681; 42678->42682; 42681->42682; 42682->42683; 42683->42684; 42684->42685; }
42661,42673
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time