Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognition

2025-05-13 · Zeki Doruk Erden, Donia Gasmi, Boi Faltings

Continual learning for reinforcement learning agents remains a significant challenge, particularly in preserving and leveraging existing information without an external signal to indicate changes in tasks or environments. In this study, we explore the effectiveness of autoencoders in detecting new tasks and matching observed environments to previously encountered ones. Our approach integrates policy optimization with familiarity autoencoders within an end-to-end continual learning system. This system can recognize and learn new tasks or environments while preserving knowledge from earlier experiences and can selectively retrieve relevant knowledge when re-encountering a known environment. Initial results demonstrate successful continual learning without external signals to indicate task changes or reencounters, showing promise for this methodology.

📄 PDF Abstract BibTeX arXiv:2505.09003

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Avalanche RL: a Continual Reinforcement Learning Library

2022-02-28 · Nicolò Lucchesi, Antonio Carta, Vincenzo Lomonaco, Davide Bacciu

Continual Reinforcement Learning (CRL) is a challenging setting where an agent learns to interact with an environment that is constantly changing over time (the stream of experiences). In this paper, we describe Avalanch…

Continual Learning OpenAI Gym reinforcement-learning Reinforcement Learning+1

Safe Continual Reinforcement Learning in Non-stationary Environments

2026-04-21 · Austin Coursey, Abel Diaz-Gonzalez, Marcos Quinones-Grueiro, Gautam Biswas arxiv

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assu…

Reinforcement Learning

Continual Reinforcement Learning for HVAC Systems Control: Integrating Hypernetworks and Transfer Learning

2025-03-24 · Gautham Udayakumar Bekal, Ahmed Ghareeb, Ashish Pujari

Buildings with Heating, Ventilation, and Air Conditioning (HVAC) systems play a crucial role in ensuring indoor comfort and efficiency. While traditionally governed by physics-based models, the emergence of big data has …

Continual Learning Deep Reinforcement Learning Model-based Reinforcement Learning reinforcement-learning+3

The Dreaming Variational Autoencoder for Reinforcement Learning Environments

2018-10-02 · Per-Arne Andersen, Morten Goodwin, Ole-Christoffer Granmo

Reinforcement learning has shown great potential in generalizing over raw sensory data using only a single neural network for value optimization. There are several challenges in the current state-of-the-art reinforcement…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe Continual Reinforcement Learning Methods for Nonstationary Environments. Towards a Survey of the State of the Art

2026-01-08 · Timofey Tomashevskiy arxiv

This work provides a state-of-the-art survey of continual safe online reinforcement learning (COSRL) methods. We discuss theoretical aspects, challenges, and open questions in building continual online safe reinforcement…

Reinforcement Learning Continual Learning