paper-with-me

Papers

MBORE: Multi-objective Bayesian Optimisation by Density-Ratio Estimation

2022-03-31 · George De Ath, Tinkle Chugh, Alma A. M. Rahat

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions. It combines objective values via scalarisation and builds a Gaussian process (GP) surrogate of the scalarised values. The location which maximises a cheap-to-query acquisition function is chosen as the next location to expensively evaluate. While BO is an effective strategy, the use of GPs is limiting. Their performance decreases as the problem input dimensionality increases, and their computational complexity scales cubically with the amount of data. To address these limitations, we extend previous work on BO by density-ratio estimation (BORE) to the multi-objective setting. BORE links the computation of the probability of improvement acquisition function to that of probabilistic classification. This enables the use of state-of-the-art classifiers in a BO-like framework. In this work we present MBORE: multi-objective Bayesian optimisation by density-ratio estimation, and compare it to BO across a range of synthetic and real-world benchmarks. We find that MBORE performs as well as or better than BO on a wide variety of problems, and that it outperforms BO on high-dimensional and real-world problems.

📄 PDF Abstract BibTeX arXiv:2203.16912

Code (1)

georgedeath/mbore 공식 구현 pytorch

Tasks

Bayesian OptimisationDensity Ratio Estimation

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Wind Farm Layout Optimisation using Set Based Multi-objective Bayesian Optimisation

2022-03-31 · Tinkle Chugh, Endi Ymeraj

Wind energy is one of the cleanest renewable electricity sources and can help in addressing the challenge of climate change. One of the drawbacks of wind-generated energy is the large space necessary to install a wind fa…

Bayesian Optimisation

Generalisation under gradient descent via deterministic PAC-Bayes

2022-09-06 · Eugenio Clerico, Tyler Farghly, George Deligiannidis, Benjamin Guedj 외

We establish disintegrated PAC-Bayesian generalisation bounds for models trained with gradient descent methods or continuous gradient flows. Contrary to standard practice in the PAC-Bayesian setting, our result applies t…

Cost-aware Multi-objective Bayesian optimisation

2019-09-09 · Majid Abdolshah, Alistair Shilton, Santu Rana, Sunil Gupta 외

The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box object…

Bayesian Optimisation

Batch Bayesian Optimization via Particle Gradient Flows

2022-09-10 · Enrico Crovini, Simon L. Cotter, Konstantinos Zygalakis, Andrew B. Duncan

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective functi…

Bayesian InferenceBayesian OptimisationBayesian Optimization

Approximate Bayesian Optimisation for Neural Networks

2021-08-27 · Nadhir Hassen, Irina Rish

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result t…

Bayesian OptimisationDensity Ratio EstimationGaussian Processes