3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16248 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 597670
Shuffle Read Size / Records:
8.3 MiB / 173748
Shuffle Write Size / Records:
33.3 MiB / 603650
Associated Job Ids:
7936
DAG Visualization
digraph G { subgraph clusterstage_16248 { label="Stage 16248"; subgraph cluster104136 { label="AQEShuffleRead"; 44486 [labelType="html" label="ShuffledRowRDD [44486] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104133 { label="WholeStageCodegen (18)"; 44487 [labelType="html" label="MapPartitionsRDD [44487] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104132 { label="Window"; 44488 [labelType="html" label="MapPartitionsRDD [44488] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104130 { label="Filter"; 44489 [labelType="html" label="MapPartitionsRDD [44489] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104129 { label="Project"; 44490 [labelType="html" label="MapPartitionsRDD [44490] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104128 { label="Project"; 44491 [labelType="html" label="MapPartitionsRDD [44491] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104127 { label="Project"; 44492 [labelType="html" label="MapPartitionsRDD [44492] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104126 { label="Project"; 44493 [labelType="html" label="MapPartitionsRDD [44493] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104125 { label="Project"; 44494 [labelType="html" label="MapPartitionsRDD [44494] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104142 { label="Scan parquet "; 44495 [labelType="html" label="FileScanRDD [44495]<br>rdd at PersistJob.java:28"]; 44496 [labelType="html" label="MapPartitionsRDD [44496]<br>rdd at PersistJob.java:28"]; } subgraph cluster104137 { label="WholeStageCodegen (20)"; 44497 [labelType="html" label="MapPartitionsRDD [44497]<br>rdd at PersistJob.java:28"]; } subgraph cluster104116 { label="Union"; 44498 [labelType="html" label="UnionRDD [44498] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster104115 { label="Exchange"; 44502 [labelType="html" label="MapPartitionsRDD [44502] [Unordered]<br>rdd at PersistJob.java:28"]; } } 44486->44487; 44487->44488; 44488->44489; 44489->44490; 44490->44491; 44491->44492; 44492->44493; 44493->44494; 44495->44496; 44496->44497; 44494->44498; 44497->44498; 44498->44502; }
44485,44486
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time