paper-with-me

Papers

Parametric-Task MAP-Elites

2024-02-02 · Timothée Anne, Jean-Baptiste Mouret

Optimizing a set of functions simultaneously by leveraging their similarity is called multi-task optimization. Current black-box multi-task algorithms only solve a finite set of tasks, even when the tasks originate from a continuous space. In this paper, we introduce Parametric-Task MAP-Elites (PT-ME), a new black-box algorithm for continuous multi-task optimization problems. This algorithm (1) solves a new task at each iteration, effectively covering the continuous space, and (2) exploits a new variation operator based on local linear regression. The resulting dataset of solutions makes it possible to create a function that maps any task parameter to its optimal solution. We show that PT-ME outperforms all baselines, including the deep reinforcement learning algorithm PPO on two parametric-task toy problems and a robotic problem in simulation.

📄 PDF Abstract BibTeX arXiv:2402.01275

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Similar Papers 제목 키워드 기반

Multi-Task Multi-Behavior MAP-Elites

2023-05-02 · Anne, Mouret

We propose Multi-Task Multi-Behavior MAP-Elites, a variant of MAP-Elites that finds a large number of high-quality solutions for a large set of tasks (optimization problems from a given family). It combines the original …

Diversity

Multi-Emitter MAP-Elites: Improving quality, diversity and convergence speed with heterogeneous sets of emitters

2020-07-10 · Antoine Cully

Quality-Diversity (QD) optimisation is a new family of learning algorithms that aims at generating collections of diverse and high-performing solutions. Among those algorithms, the recently introduced Covariance Matrix A…

Diversity

Scaling MAP-Elites to Deep Neuroevolution

2020-03-03 · Cédric Colas, Joost Huizinga, Vashisht Madhavan, Jeff Clune

Quality-Diversity (QD) algorithms, and MAP-Elites (ME) in particular, have proven very useful for a broad range of applications including enabling real robots to recover quickly from joint damage, solving strongly decept…

DiversityEfficient Exploration

Synergizing Quality-Diversity with Descriptor-Conditioned Reinforcement Learning

2023-12-10 · Maxence Faldor, Félix Chalumeau, Manon Flageat, Antoine Cully

A hallmark of intelligence is the ability to exhibit a wide range of effective behaviors. Inspired by this principle, Quality-Diversity algorithms, such as MAP-Elites, are evolutionary methods designed to generate a set …

Continuous ControlDiversityEvolutionary Algorithmsreinforcement-learning+1

MAP-Elites with Descriptor-Conditioned Gradients and Archive Distillation into a Single Policy

2023-03-07 · Maxence Faldor, Félix Chalumeau, Manon Flageat, Antoine Cully

Quality-Diversity algorithms, such as MAP-Elites, are a branch of Evolutionary Computation generating collections of diverse and high-performing solutions, that have been successfully applied to a variety of domains and …

Deep Reinforcement Learning