Disentangled Skill Embeddings for Reinforcement Learning

2019-06-21 · Janith C. Petangoda, Sergio Pascual-Diaz, Vincent Adam, Peter Vrancx, Jordi Grau-Moya

We propose a novel framework for multi-task reinforcement learning (MTRL). Using a variational inference formulation, we learn policies that generalize across both changing dynamics and goals. The resulting policies are parametrized by shared parameters that allow for transfer between different dynamics and goal conditions, and by task-specific latent-space embeddings that allow for specialization to particular tasks. We show how the latent-spaces enable generalization to unseen dynamics and goals conditions. Additionally, policies equipped with such embeddings serve as a space of skills (or options) for hierarchical reinforcement learning. Since we can change task dynamics and goals independently, we name our framework Disentangled Skill Embeddings (DSE).

📄 PDF Abstract BibTeX arXiv:1906.09223

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Variational Inference

Disentangled Unsupervised Skill Discovery for Efficient Hierarchical Reinforcement Learning

2024-10-15 · Jiaheng Hu, Zizhao Wang, Peter Stone, Roberto Martín-Martín

A hallmark of intelligent agents is the ability to learn reusable skills purely from unsupervised interaction with the environment. However, existing unsupervised skill discovery methods often learn entangled skills wher…

Disentanglement Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning

Weakly-Supervised Learning of Disentangled and Interpretable Skills for Hierarchical Reinforcement Learning

2021-09-29 · Wonil Song, Sangryul Jeon, Hyesong Choi, Kwanghoon Sohn 외

Hierarchical reinforcement learning (RL) usually requires task-agnostic and interpretable skills that can be applicable to various downstream tasks. While many recent works have been proposed to learn such skills for a p…

Decoder Hierarchical Reinforcement Learning Inductive Bias reinforcement-learning+2

Adversarial Skill Networks: Unsupervised Robot Skill Learning from Video

2019-10-21 · Oier Mees, Markus Merklinger, Gabriel Kalweit, Wolfram Burgard

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approac…

continuous-control Continuous Control Metric Learning Reinforcement Learning+4

Weakly Supervised Disentangled Representation for Goal-conditioned Reinforcement Learning

2022-02-28 · Zhifeng Qian, Mingyu You, Hongjun Zhou, Bin He

Goal-conditioned reinforcement learning is a crucial yet challenging algorithm which enables agents to achieve multiple user-specified goals when learning a set of skills in a dynamic environment. However, it typically r…

Position reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery

2022-02-01 · Michael Laskin, Hao liu, Xue Bin Peng, Denis Yarats 외

We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning …

Contrastive Learning Diversity reinforcement-learning Reinforcement Learning (RL)+1