3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 16158 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Input Size / Records:
110.0 B / 1
Shuffle Read Size / Records:
21.2 KiB / 528
Shuffle Write Size / Records:
26.4 KiB / 426
Associated Job Ids:
8146
DAG Visualization
digraph G { subgraph clusterstage_16158 { label="Stage 16158"; subgraph cluster105693 { label="AQEShuffleRead"; 45447 [labelType="html" label="ShuffledRowRDD [45447] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105690 { label="WholeStageCodegen (60)"; 45448 [labelType="html" label="MapPartitionsRDD [45448] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105689 { label="Window"; 45449 [labelType="html" label="MapPartitionsRDD [45449] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105683 { label="WholeStageCodegen (61)"; 45450 [labelType="html" label="MapPartitionsRDD [45450] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105698 { label="Scan csv "; 45451 [labelType="html" label="FileScanRDD [45451]<br>parquet at PersistJob.java:35"]; 45452 [labelType="html" label="MapPartitionsRDD [45452]<br>parquet at PersistJob.java:35"]; } subgraph cluster105694 { label="WholeStageCodegen (62)"; 45453 [labelType="html" label="MapPartitionsRDD [45453]<br>parquet at PersistJob.java:35"]; } subgraph cluster105682 { label="CartesianProduct"; 45454 [labelType="html" label="UnsafeCartesianRDD [45454] [Unordered]<br>parquet at PersistJob.java:35"]; 45455 [labelType="html" label="MapPartitionsRDD [45455] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster105681 { label="Exchange"; 45456 [labelType="html" label="MapPartitionsRDD [45456] [Unordered]<br>parquet at PersistJob.java:35"]; } } 45447->45448; 45448->45449; 45449->45450; 45451->45452; 45452->45453; 45450->45454; 45453->45454; 45454->45455; 45455->45456; }
45446,45447
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time