3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 44967 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
41 s
Locality Level Summary:
Any: 10; Process local: 10
Input Size / Records:
86.7 MiB / 1904714
Shuffle Read Size / Records:
16.9 MiB / 344297
Shuffle Write Size / Records:
106.2 MiB / 1898859
Associated Job Ids:
23857
DAG Visualization
digraph G { subgraph clusterstage_44967 { label="Stage 44967"; subgraph cluster309904 { label="Exchange"; 135702 [labelType="html" label="ShuffledRowRDD [135702] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309895 { label="WholeStageCodegen (18)"; 135705 [labelType="html" label="MapPartitionsRDD [135705] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309894 { label="Window"; 135706 [labelType="html" label="MapPartitionsRDD [135706] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309892 { label="Filter"; 135707 [labelType="html" label="MapPartitionsRDD [135707] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309891 { label="Project"; 135708 [labelType="html" label="MapPartitionsRDD [135708] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309890 { label="Project"; 135709 [labelType="html" label="MapPartitionsRDD [135709] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309889 { label="Project"; 135710 [labelType="html" label="MapPartitionsRDD [135710] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309888 { label="Project"; 135711 [labelType="html" label="MapPartitionsRDD [135711] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309887 { label="Project"; 135712 [labelType="html" label="MapPartitionsRDD [135712] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309910 { label="Scan parquet "; 135713 [labelType="html" label="FileScanRDD [135713]<br>rdd at PersistJob.java:28"]; 135714 [labelType="html" label="MapPartitionsRDD [135714]<br>rdd at PersistJob.java:28"]; } subgraph cluster309905 { label="WholeStageCodegen (20)"; 135715 [labelType="html" label="MapPartitionsRDD [135715]<br>rdd at PersistJob.java:28"]; } subgraph cluster309878 { label="Union"; 135716 [labelType="html" label="UnionRDD [135716] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster309877 { label="Exchange"; 135855 [labelType="html" label="MapPartitionsRDD [135855] [Unordered]<br>rdd at PersistJob.java:28"]; } } 135702->135705; 135705->135706; 135706->135707; 135707->135708; 135708->135709; 135709->135710; 135710->135711; 135711->135712; 135713->135714; 135714->135715; 135712->135716; 135715->135716; 135716->135855; }
135700,135702
Event Timeline
Enable zooming
Tasks: 20. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time