3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 15336 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 5; Process local: 10
Input Size / Records:
28.5 MiB / 598988
Shuffle Read Size / Records:
8.4 MiB / 175588
Associated Job Ids:
8068
DAG Visualization
digraph G { subgraph clusterstage_15336 { label="Stage 15336"; subgraph cluster99144 { label="AQEShuffleRead"; 41875 [labelType="html" label="ShuffledRowRDD [41875] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99141 { label="WholeStageCodegen (18)"; 41876 [labelType="html" label="MapPartitionsRDD [41876] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99140 { label="Window"; 41877 [labelType="html" label="MapPartitionsRDD [41877] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99138 { label="Filter"; 41878 [labelType="html" label="MapPartitionsRDD [41878] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99137 { label="Project"; 41879 [labelType="html" label="MapPartitionsRDD [41879] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99136 { label="Project"; 41880 [labelType="html" label="MapPartitionsRDD [41880] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99135 { label="Project"; 41881 [labelType="html" label="MapPartitionsRDD [41881] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99134 { label="Project"; 41882 [labelType="html" label="MapPartitionsRDD [41882] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99133 { label="Project"; 41883 [labelType="html" label="MapPartitionsRDD [41883] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99150 { label="Scan parquet "; 41884 [labelType="html" label="FileScanRDD [41884]<br>rdd at PersistJob.java:28"]; 41885 [labelType="html" label="MapPartitionsRDD [41885]<br>rdd at PersistJob.java:28"]; } subgraph cluster99145 { label="WholeStageCodegen (20)"; 41886 [labelType="html" label="MapPartitionsRDD [41886]<br>rdd at PersistJob.java:28"]; } subgraph cluster99124 { label="Union"; 41887 [labelType="html" label="UnionRDD [41887] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster99123 { label="Exchange"; 41888 [labelType="html" label="MapPartitionsRDD [41888] [Unordered]<br>rdd at PersistJob.java:28"]; 41889 [labelType="html" label="MapPartitionsRDD [41889] [Unordered]<br>rdd at PersistJob.java:28"]; 41890 [labelType="html" label="MapPartitionsRDD [41890] [Unordered]<br>rdd at PersistJob.java:28"]; } } 41875->41876; 41876->41877; 41877->41878; 41878->41879; 41879->41880; 41880->41881; 41881->41882; 41882->41883; 41884->41885; 41885->41886; 41883->41887; 41886->41887; 41887->41888; 41888->41889; 41889->41890; }
41874,41875
Event Timeline
Enable zooming
Tasks: 15. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time