3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16123 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 ms
Locality Level Summary:
Any: 1
Input Size / Records:
175.0 B / 1
Shuffle Read Size / Records:
7.6 KiB / 500
Shuffle Write Size / Records:
3.8 KiB / 177
Associated Job Ids:
7884
DAG Visualization
digraph G { subgraph clusterstage_16123 { label="Stage 16123"; subgraph cluster103370 { label="AQEShuffleRead"; 44184 [labelType="html" label="ShuffledRowRDD [44184] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103367 { label="WholeStageCodegen (17)"; 44185 [labelType="html" label="MapPartitionsRDD [44185] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103375 { label="AQEShuffleRead"; 44186 [labelType="html" label="ShuffledRowRDD [44186] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103372 { label="WholeStageCodegen (18)"; 44187 [labelType="html" label="MapPartitionsRDD [44187] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103363 { label="WholeStageCodegen (19)"; 44188 [labelType="html" label="ZippedPartitionsRDD2 [44188] [Unordered]<br>parquet at PersistJob.java:35"]; 44189 [labelType="html" label="MapPartitionsRDD [44189] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103380 { label="Scan csv "; 44190 [labelType="html" label="FileScanRDD [44190]<br>parquet at PersistJob.java:35"]; 44191 [labelType="html" label="MapPartitionsRDD [44191]<br>parquet at PersistJob.java:35"]; } subgraph cluster103376 { label="WholeStageCodegen (20)"; 44192 [labelType="html" label="MapPartitionsRDD [44192]<br>parquet at PersistJob.java:35"]; } subgraph cluster103362 { label="CartesianProduct"; 44193 [labelType="html" label="UnsafeCartesianRDD [44193] [Unordered]<br>parquet at PersistJob.java:35"]; 44194 [labelType="html" label="MapPartitionsRDD [44194] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103359 { label="WholeStageCodegen (21)"; 44195 [labelType="html" label="MapPartitionsRDD [44195] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster103358 { label="Exchange"; 44196 [labelType="html" label="MapPartitionsRDD [44196] [Unordered]<br>parquet at PersistJob.java:35"]; } } 44184->44185; 44186->44187; 44185->44188; 44187->44188; 44188->44189; 44190->44191; 44191->44192; 44189->44193; 44192->44193; 44193->44194; 44194->44195; 44195->44196; }
44179,44184
44183,44186
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time