Learning Generative Models with Goal-conditioned Reinforcement Learning

2023-03-26 · Mariana Vargas Vieyra, Pierre Ménard

We present a novel, alternative framework for learning generative models with goal-conditioned reinforcement learning. We define two agents, a goal conditioned agent (GC-agent) and a supervised agent (S-agent). Given a user-input initial state, the GC-agent learns to reconstruct the training set. In this context, elements in the training set are the goals. During training, the S-agent learns to imitate the GC-agent while remaining agnostic of the goals. At inference we generate new samples with the S-agent. Following a similar route as in variational auto-encoders, we derive an upper bound on the negative log-likelihood that consists of a reconstruction term and a divergence between the GC-agent policy and the (goal-agnostic) S-agent policy. We empirically demonstrate that our method is able to generate diverse and high quality samples in the task of image synthesis.

📄 PDF Abstract BibTeX arXiv:2303.14811

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation reinforcement-learning Reinforcement Learning

Why Goal-Conditioned Reinforcement Learning Works: Relation to Dual Control

2025-12-06 · Nathan P. Lawrence, Ali Mesbah arxiv

Goal-conditioned reinforcement learning (RL) concerns the problem of training an agent to maximize the probability of reaching target goal states. This paper presents an analysis of the goal-conditioned setting based on …

Reinforcement Learning

Goal-Conditioned Data Augmentation for Offline Reinforcement Learning

2024-12-29 · Xingshuai Huang, Di Wu Member, Benoit Boulet

Offline reinforcement learning (RL) enables policy learning from pre-collected offline datasets, relaxing the need to interact directly with the environment. However, limited by the quality of offline datasets, it genera…

D4RL Data Augmentation Offline RL reinforcement-learning+3

GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models

2023-10-30 · Mianchu Wang, Rui Yang, Xi Chen, Hao Sun 외

Offline Goal-Conditioned RL (GCRL) offers a feasible paradigm for learning general-purpose policies from diverse and multi-task offline datasets. Despite notable recent progress, the predominant offline GCRL methods, mai…

Generative Adversarial Network reinforcement-learning

Contextual Imagined Goals for Self-Supervised Robotic Learning

2019-10-23 · Ashvin Nair, Shikhar Bahl, Alexander Khazatsky, Vitchyr Pong 외

While reinforcement learning provides an appealing formalism for learning individual skills, a general-purpose robotic system must be able to master an extensive repertoire of behaviors. Instead of learning a large colle…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Swapped goal-conditioned offline reinforcement learning

2023-02-17 · Wenyan Yang, Huiling Wang, Dingding Cai, Joni Pajarinen 외

Offline goal-conditioned reinforcement learning (GCRL) can be challenging due to overfitting to the given dataset. To generalize agents' skills outside the given dataset, we propose a goal-swapping procedure that generat…

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)