paper-with-me

홈 › Papers

Toward Task Generalization via Memory Augmentation in Meta-Reinforcement Learning

2025-02-03 · Kaixi Bao, Chenhao Li, Yarden As, Andreas Krause, Marco Hutter

Agents trained via reinforcement learning (RL) often struggle to perform well on tasks that differ from those encountered during training. This limitation presents a challenge to the broader deployment of RL in diverse and dynamic task settings. In this work, we introduce memory augmentation, a memory-based RL approach to improve task generalization. Our approach leverages task-structured augmentations to simulate plausible out-of-distribution scenarios and incorporates memory mechanisms to enable context-aware policy adaptation. Trained on a predefined set of tasks, our policy demonstrates the ability to generalize to unseen tasks through memory augmentation without requiring additional interactions with the environment. Through extensive simulation experiments and real-world hardware evaluations on legged locomotion tasks, we demonstrate that our approach achieves zero-shot generalization to unseen tasks while maintaining robust in-distribution performance and high sample efficiency.

📄 PDF Abstract BibTeX arXiv:2502.01521

Code (0)

등록된 구현이 없습니다.

Tasks

Meta Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Zero-shot Generalization

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Learning Invariances for Policy Generalization

2018-09-07 · Remi Tachet, Philip Bachman, Harm van Seijen

While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simp…

BIG-bench Machine LearningData AugmentationMeta-Learningreinforcement-learning+2

Transformers are Meta-Reinforcement Learners

2021-09-29 · Luckeciano Carvalho Melo

The transformer architecture and variants presented a remarkable success across many machine learning tasks in recent years. This success is intrinsically related to the capability of handling long sequences and the pres…

continuous-controlContinuous ControlMeta Reinforcement LearningOut-of-Distribution Generalization+3

A Recipe for Unbounded Data Augmentation in Visual Reinforcement Learning

2024-05-27 · Abdulaziz Almuzairee, Nicklas Hansen, Henrik I. Christensen

Q-learning algorithms are appealing for real-world applications due to their data-efficiency, but they are very prone to overfitting and training instabilities when trained from visual observations. Prior work, namely SV…

Data AugmentationQ-Learningreinforcement-learningReinforcement Learning

Improving Generalization in Meta-learning via Task Augmentation

2020-07-26 · Huaxiu Yao, Long-Kai Huang, Linjun Zhang, Ying WEI 외

Meta-learning has proven to be a powerful paradigm for transferring the knowledge from previous tasks to facilitate the learning of a novel task. Current dominant algorithms train a well-generalized model initialization …

Meta-Learning

p-Meta: Towards On-device Deep Model Adaptation

2022-06-25 · Zhongnan Qu, Zimu Zhou, Yongxin Tong, Lothar Thiele

Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on Io…

DiversityFew-Shot Image Classificationimage-classificationImage Classification+1