paper-with-me

홈 › Papers

Expensive Multi-Objective Bayesian Optimization Based on Diffusion Models

2024-05-14 · Bingdong Li, Zixiang Di, Yongfan Lu, Hong Qian, Feng Wang, Peng Yang, Ke Tang, Aimin Zhou

Multi-objective Bayesian optimization (MOBO) has shown promising performance on various expensive multi-objective optimization problems (EMOPs). However, effectively modeling complex distributions of the Pareto optimal solutions is difficult with limited function evaluations. Existing Pareto set learning algorithms may exhibit considerable instability in such expensive scenarios, leading to significant deviations between the obtained solution set and the Pareto set (PS). In this paper, we propose a novel Composite Diffusion Model based Pareto Set Learning algorithm, namely CDM-PSL, for expensive MOBO. CDM-PSL includes both unconditional and conditional diffusion model for generating high-quality samples. Besides, we introduce an information entropy based weighting method to balance different objectives of EMOPs. This method is integrated with the guiding strategy, ensuring that all the objectives are appropriately balanced and given due consideration during the optimization process; Extensive experimental results on both synthetic benchmarks and real-world problems demonstrates that our proposed algorithm attains superior performance compared with various state-of-the-art MOBO algorithms.

📄 PDF Abstract BibTeX arXiv:2405.08674

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SPREAD: Sampling-based Pareto front Refinement via Efficient Adaptive Diffusion

2025-09-25 · Sedjro Salomon Hotegni, Sebastian Peitz arxiv

Developing efficient multi-objective optimization methods to compute the Pareto set of optimal compromises between conflicting objectives remains a key challenge, especially for large-scale and expensive problems. To bri…

Regularized infill criteria for multi-objective Bayesian optimization with application to aircraft design

2025-04-11 · Robin Grapin, Youssef Diouane, Joseph Morlier, Nathalie Bartoli 외

Bayesian optimization is an advanced tool to perform ecient global optimization It consists on enriching iteratively surrogate Kriging models of the objective and the constraints both supposed to be computationally expen…

Bayesian Optimizationglobal-optimizationMixture-of-Experts

Controllable Expensive Multi-objective Learning with Warm-starting Bayesian Optimization

2023-11-26 · Quang-Huy Nguyen, Long P. Hoang, Hoang V. Viet, Dung D. Le

Pareto Set Learning (PSL) is a promising approach for approximating the entire Pareto front in multi-objective optimization (MOO) problems. However, existing derivative-free PSL methods are often unstable and inefficient…

Bayesian OptimizationGaussian Processes

Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints

2016-09-05 · Eduardo C. Garrido-Merchán, Daniel Hernández-Lobato

This work presents PESMOC, Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints, an information-based strategy for the simultaneous optimization of multiple expensive-to-evaluate black-box…

Bayesian Optimization

A Robust Multi-Objective Bayesian Optimization Framework Considering Input Uncertainty

2022-02-25 · J. Qing, I. Couckuyt, T. Dhaene

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as…

Bayesian Optimization