3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16708 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 3
Input Size / Records:
10.8 KiB / 3
Shuffle Read Size / Records:
4.1 MiB / 270457
Shuffle Write Size / Records:
1784.9 KiB / 76341
Associated Job Ids:
8136
DAG Visualization
digraph G { subgraph clusterstage_16708 { label="Stage 16708"; subgraph cluster106720 { label="AQEShuffleRead"; 45549 [labelType="html" label="ShuffledRowRDD [45549] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106717 { label="WholeStageCodegen (9)"; 45550 [labelType="html" label="MapPartitionsRDD [45550] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106716 { label="Window"; 45551 [labelType="html" label="MapPartitionsRDD [45551] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106713 { label="WholeStageCodegen (10)"; 45552 [labelType="html" label="MapPartitionsRDD [45552] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106712 { label="Window"; 45553 [labelType="html" label="MapPartitionsRDD [45553] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106708 { label="WholeStageCodegen (11)"; 45554 [labelType="html" label="MapPartitionsRDD [45554] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106725 { label="Scan parquet "; 45555 [labelType="html" label="FileScanRDD [45555]<br>parquet at PersistJob.java:35"]; 45556 [labelType="html" label="MapPartitionsRDD [45556]<br>parquet at PersistJob.java:35"]; } subgraph cluster106721 { label="WholeStageCodegen (12)"; 45557 [labelType="html" label="MapPartitionsRDD [45557]<br>parquet at PersistJob.java:35"]; } subgraph cluster106707 { label="CartesianProduct"; 45558 [labelType="html" label="UnsafeCartesianRDD [45558] [Unordered]<br>parquet at PersistJob.java:35"]; 45559 [labelType="html" label="MapPartitionsRDD [45559] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106704 { label="WholeStageCodegen (13)"; 45560 [labelType="html" label="MapPartitionsRDD [45560] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster106703 { label="Exchange"; 45561 [labelType="html" label="MapPartitionsRDD [45561] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45549->45550; 45550->45551; 45551->45552; 45552->45553; 45553->45554; 45555->45556; 45556->45557; 45554->45558; 45557->45558; 45558->45559; 45559->45560; 45560->45561; }
45548,45549
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time