paper-with-me

Papers

Multi-objective optimization via equivariant deep hypervolume approximation

2022-10-05 · Jim Boelrijk, Bernd Ensing, Patrick Forré

Optimizing multiple competing objectives is a common problem across science and industry. The inherent inextricable trade-off between those objectives leads one to the task of exploring their Pareto front. A meaningful quantity for the purpose of the latter is the hypervolume indicator, which is used in Bayesian Optimization (BO) and Evolutionary Algorithms (EAs). However, the computational complexity for the calculation of the hypervolume scales unfavorably with increasing number of objectives and data points, which restricts its use in those common multi-objective optimization frameworks. To overcome these restrictions we propose to approximate the hypervolume function with a deep neural network, which we call DeepHV. For better sample efficiency and generalization, we exploit the fact that the hypervolume is scale-equivariant in each of the objectives as well as permutation invariant w.r.t. both the objectives and the samples, by using a deep neural network that is equivariant w.r.t. the combined group of scalings and permutations. We evaluate our method against exact, and approximate hypervolume methods in terms of accuracy, computation time, and generalization. We also apply and compare our methods to state-of-the-art multi-objective BO methods and EAs on a range of synthetic benchmark test cases. The results show that our methods are promising for such multi-objective optimization tasks.

📄 PDF Abstract BibTeX arXiv:2210.02177

Code (1)

jimbo994/deephv-iclr 공식 구현

Tasks

Bayesian OptimizationEvolutionary Algorithms

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

HV-Net: Hypervolume Approximation based on DeepSets

2022-03-04 · Ke Shang, WeiYu Chen, Weiduo Liao, Hisao Ishibuchi

In this letter, we propose HV-Net, a new method for hypervolume approximation in evolutionary multi-objective optimization. The basic idea of HV-Net is to use DeepSets, a deep neural network with permutation invariant pr…

Multiplicative Approximations, Optimal Hypervolume Distributions, and the Choice of the Reference Point

2013-09-16 · Tobias Friedrich, Frank Neumann, Christian Thyssen

Many optimization problems arising in applications have to consider several objective functions at the same time. Evolutionary algorithms seem to be a very natural choice for dealing with multi-objective problems as the …

Evolutionary Algorithms

Uncrowded Hypervolume-based Multi-objective Optimization with Gene-pool Optimal Mixing

2020-04-10 · S. C. Maree, T. Alderliesten, P. A. N. Bosman

Domination-based multi-objective (MO) evolutionary algorithms (EAs) are today arguably the most frequently used type of MOEA. These methods however stagnate when the majority of the population becomes non-dominated, prev…

Evolutionary Algorithms

Learning to Approximate: Auto Direction Vector Set Generation for Hypervolume Contribution Approximation

2022-01-18 · Ke Shang, Tianye Shu, Hisao Ishibuchi

Hypervolume contribution is an important concept in evolutionary multi-objective optimization (EMO). It involves in hypervolume-based EMO algorithms and hypervolume subset selection algorithms. Its main drawback is that …

Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimization

2022-05-11 · Hao Wang, Kaifeng Yang, Michael Affenzeller

Hypervolume improvement (HVI) is commonly employed in multi-objective Bayesian optimization algorithms to define acquisition functions due to its Pareto-compliant property. Rather than focusing on specific statistical mo…

Bayesian Optimization