paper-with-me

Papers

Vector Optimization with Gaussian Process Bandits

2024-12-03 · İlter Onat Korkmaz, Yaşar Cahit Yıldırım, Çağın Ararat, Cem Tekin

Learning problems in which multiple conflicting objectives must be considered simultaneously often arise in various fields, including engineering, drug design, and environmental management. Traditional methods for dealing with multiple black-box objective functions, such as scalarization and identification of the Pareto set under the componentwise order, have limitations in incorporating objective preferences and exploring the solution space accordingly. While vector optimization offers improved flexibility and adaptability via specifying partial orders based on ordering cones, current techniques designed for sequential experiments either suffer from high sample complexity or lack theoretical guarantees. To address these issues, we propose Vector Optimization with Gaussian Process (VOGP), a probably approximately correct adaptive elimination algorithm that performs black-box vector optimization using Gaussian process bandits. VOGP allows users to convey objective preferences through ordering cones while performing efficient sampling by exploiting the smoothness of the objective function, resulting in a more effective optimization process that requires fewer evaluations. We establish theoretical guarantees for VOGP and derive information gain-based and kernel-specific sample complexity bounds. We also conduct experiments on both real-world and synthetic datasets to compare VOGP with the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2412.02484

Code (1)

Bilkent-CYBORG/VOGP 공식 구현 pytorch

Tasks

Drug Design

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Vector-valued self-normalized concentration inequalities beyond sub-Gaussianity

2025-11-05 · Diego Martinez-Taboada, Tomas Gonzalez, Aaditya Ramdas arxiv

The study of self-normalized processes plays a crucial role in a wide range of applications, from sequential decision-making to econometrics. While the behavior of self-normalized concentration has been widely investigat…

Stochastic Process Bandits: Upper Confidence Bounds Algorithms via Generic Chaining

2016-02-16 · Emile Contal, Nicolas Vayatis

The paper considers the problem of global optimization in the setup of stochastic process bandits. We introduce an UCB algorithm which builds a cascade of discretization trees based on generic chaining in order to render…

Gaussian Processesglobal-optimization

On Kernelized Multi-armed Bandits

2017-04-03 · ICML 2017 8 · Sayak Ray Chowdhury, Aditya Gopalan

We consider the stochastic bandit problem with a continuous set of arms, with the expected reward function over the arms assumed to be fixed but unknown. We provide two new Gaussian process-based algorithms for continuou…

Multi-Armed Bandits

Weighted Gaussian Process Bandits for Non-stationary Environments

2021-07-06 · Yuntian Deng, Xingyu Zhou, Baekjin Kim, Ambuj Tewari 외

In this paper, we consider the Gaussian process (GP) bandit optimization problem in a non-stationary environment. To capture external changes, the black-box function is allowed to be time-varying within a reproducing ker…

regression

LITE: Efficiently Estimating Gaussian Probability of Maximality

2025-01-23 · Nicolas Menet, Jonas Hübotter, Parnian Kassraie, Andreas Krause

We consider the problem of computing the probability of maximality (PoM) of a Gaussian random vector, i.e., the probability for each dimension to be maximal. This is a key challenge in applications ranging from Bayesian …

Bayesian OptimizationDrug Discovery