paper-with-me

Papers

Data-Driven Preference Sampling for Pareto Front Learning

2024-04-12 · Rongguang Ye, Lei Chen, Weiduo Liao, Jinyuan Zhang, Hisao Ishibuchi

Pareto front learning is a technique that introduces preference vectors in a neural network to approximate the Pareto front. Previous Pareto front learning methods have demonstrated high performance in approximating simple Pareto fronts. These methods often sample preference vectors from a fixed Dirichlet distribution. However, no fixed sampling distribution can be adapted to diverse Pareto fronts. Efficiently sampling preference vectors and accurately estimating the Pareto front is a challenge. To address this challenge, we propose a data-driven preference vector sampling framework for Pareto front learning. We utilize the posterior information of the objective functions to adjust the parameters of the sampling distribution flexibly. In this manner, the proposed method can sample preference vectors from the location of the Pareto front with a high probability. Moreover, we design the distribution of the preference vector as a mixture of Dirichlet distributions to improve the performance of the model in disconnected Pareto fronts. Extensive experiments validate the superiority of the proposed method compared with state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:2404.08397

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Evolutionary Preference Sampling for Pareto Set Learning

2024-04-12 · Rongguang Ye, Longcan Chen, Jinyuan Zhang, Hisao Ishibuchi

Recently, Pareto Set Learning (PSL) has been proposed for learning the entire Pareto set using a neural network. PSL employs preference vectors to scalarize multiple objectives, facilitating the learning of mappings from…

Evolutionary Algorithms

Pareto Front Shape-Agnostic Pareto Set Learning in Multi-Objective Optimization

2024-08-11 · Rongguang Ye, Longcan Chen, Wei-Bin Kou, Jinyuan Zhang 외

Pareto set learning (PSL) is an emerging approach for acquiring the complete Pareto set of a multi-objective optimization problem. Existing methods primarily rely on the mapping of preference vectors in the objective spa…

User-Preference Meets Pareto-Optimality: Multi-Objective Bayesian Optimization with Local Gradient Search

2025-02-10 · Joshua Hang Sai Ip, Ankush Chakrabarty, Ali Mesbah, Diego Romeres

Incorporating user preferences into multi-objective Bayesian optimization (MOBO) allows for personalization of the optimization procedure. Preferences are often abstracted in the form of an unknown utility function, esti…

Bayesian Optimization

Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences

2024-07-10 · Nikolaos Dimitriadis, Pascal Frossard, Francois Fleuret

Dealing with multi-task trade-offs during inference can be addressed via Pareto Front Learning (PFL) methods that parameterize the Pareto Front with a single model, contrary to traditional Multi-Task Learning (MTL) appro…

Multi-Task LearningScene Understanding

Beyond Compromise: Pareto-Lenient Consensus for Efficient Multi-Preference LLM Alignment

2026-04-07 · Renxuan Tan, Rongpeng Li, Zhifeng Zhao, Honggang Zhang arxiv

Transcending the single-preference paradigm, aligning LLMs with diverse human values is pivotal for robust deployment. Contemporary Multi-Objective Preference Alignment (MPA) approaches predominantly rely on static linea…