paper-with-me

Papers

Multi-Objective Quality-Diversity in Unstructured and Unbounded Spaces

2025-03-28 · Hannah Janmohamed, Antoine Cully

Quality-Diversity algorithms are powerful tools for discovering diverse, high-performing solutions. Recently, Multi-Objective Quality-Diversity (MOQD) extends QD to problems with several objectives while preserving solution diversity. MOQD has shown promise in fields such as robotics and materials science, where finding trade-offs between competing objectives like energy efficiency and speed, or material properties is essential. However, existing methods in MOQD rely on tessellating the feature space into a grid structure, which prevents their application in domains where feature spaces are unknown or must be learned, such as complex biological systems or latent exploration tasks. In this work, we introduce Multi-Objective Unstructured Repertoire for Quality-Diversity (MOUR-QD), a MOQD algorithm designed for unstructured and unbounded feature spaces. We evaluate MOUR-QD on five robotic tasks. Importantly, we show that our method excels in tasks where features must be learned, paving the way for applying MOQD to unsupervised domains. We also demonstrate that MOUR-QD is advantageous in domains with unbounded feature spaces, outperforming existing grid-based methods. Finally, we demonstrate that MOUR-QD is competitive with established MOQD methods on existing MOQD tasks and achieves double the MOQD-score in some environments. MOUR-QD opens up new opportunities for MOQD in domains like protein design and image generation.

📄 PDF Abstract BibTeX arXiv:2504.03715

Code (1)

adaptive-intelligent-robotics/MOUR-QD 공식 구현 jax

Tasks

DiversityImage GenerationProtein Design

Similar Papers 제목 키워드 기반

Quality and Diversity Optimization: A Unifying Modular Framework

2017-05-12 · Antoine Cully, Yiannis Demiris

The optimization of functions to find the best solution according to one or several objectives has a central role in many engineering and research fields. Recently, a new family of optimization algorithms, named Quality-…

DiversityManagement

Learning Hierarchical Skill Policies with Offline Quality-Diversity Reinforcement Learning

2026-08-20 · Tanachai Anakewat, Takayuki Osa, Tatsuya Harada arxiv

Recent studies investigate how to leverage pre-collected datasets to improve the policy performance and sample efficiency of RL. One promising approach to achieve this goal is to employ a two-stage strategy: In the first…

Reinforcement Learning

Concentration Inequalities for the Stochastic Optimization of Unbounded Objectives with Application to Denoising Score Matching

2025-02-12 · Jeremiah Birrell

We derive novel concentration inequalities that bound the statistical error for a large class of stochastic optimization problems, focusing on the case of unbounded objective functions. Our derivations utilize the follow…

DenoisingStochastic Optimization

Automatic Calibration of Artificial Neural Networks for Zebrafish Collective Behaviours using a Quality Diversity Algorithm

2019-07-22 · Leo Cazenille, Nicolas Bredeche, José Halloy

During the last two decades, various models have been proposed for fish collective motion. These models are mainly developed to decipher the biological mechanisms of social interaction between animals. They consider very…

DiversityReinforcement Learning

Effects of Archive Size on Computation Time and Solution Quality for Multi-Objective Optimization

2022-09-07 · Tianye Shu, Ke Shang, Hisao Ishibuchi, Yang Nan

An unbounded external archive has been used to store all nondominated solutions found by an evolutionary multi-objective optimization algorithm in some studies. It has been shown that a selected solution subset from the …