홈 › Papers

Multi-Objective Bayesian Optimization with Active Preference Learning

2023-11-22 · Ryota Ozaki, Kazuki Ishikawa, Youhei Kanzaki, Shinya Suzuki, Shion Takeno, Ichiro Takeuchi, Masayuki Karasuyama

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive search cost, while in many practical scenarios, the decision maker (DM) only needs a specific solution among the set of the Pareto optimal solutions. We propose a Bayesian optimization (BO) approach to identifying the most preferred solution in the MOO with expensive objective functions, in which a Bayesian preference model of the DM is adaptively estimated by an interactive manner based on the two types of supervisions called the pairwise preference and improvement request. To explore the most preferred solution, we define an acquisition function in which the uncertainty both in the objective functions and the DM preference is incorporated. Further, to minimize the interaction cost with the DM, we also propose an active learning strategy for the preference estimation. We empirically demonstrate the effectiveness of our proposed method through the benchmark function optimization and the hyper-parameter optimization problems for machine learning models.

📄 PDF Abstract BibTeX arXiv:2311.13460

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningBayesian Optimization

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Active Preference Learning over Latent Preference Archetypes for Many-Objective Bayesian Optimization

2026-03-30 · Manisha Dubey, Sebastiaan De Peuter, Wanrong Wang, Samuel Kaski arxiv

Preference-based many-objective Bayesian optimization typically assumes that all pairwise comparisons arise from a single latent utility function, despite real decision makers often exhibiting multiple latent preference …

Bayesian Preference Elicitation: Human-In-The-Loop Optimization of An Active Prosthesis

2026-02-26 · Sophia Taddei, Wouter Koppen, Eligia Alfio, Stefano Nuzzo 외 arxiv

Tuning active prostheses for people with amputation is time-consuming and relies on metrics that may not fully reflect user needs. We introduce a human-in-the-loop optimization (HILO) approach that leverages direct user …

A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning

2010-12-12 · Eric Brochu, Vlad M. Cora, Nando de Freitas

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combini…

Bayesian Optimization Hierarchical Reinforcement Learning Hyperparameter Optimization reinforcement-learning+2

Bayesian preference elicitation for decision support in multiobjective optimization

2025-07-22 · Felix Huber, Sebastian Rojas Gonzalez, Raul Astudillo arxiv

We present a novel approach to help decision-makers efficiently identify preferred solutions from the Pareto set of a multi-objective optimization problem. Our method uses a Bayesian model to estimate the decision-maker'…

Bayesian Optimization with Preference Exploration by Monotonic Neural Network Ensemble

2025-01-30 · HanYang Wang, Juergen Branke, Matthias Poloczek

Many real-world black-box optimization problems have multiple conflicting objectives. Rather than attempting to approximate the entire set of Pareto-optimal solutions, interactive preference learning allows to focus the …

Bayesian Optimization