t-DGR: A Trajectory-Based Deep Generative Replay Method for Continual Learning in Decision Making

2024-01-04 · William Yue, Bo Liu, Peter Stone

Deep generative replay has emerged as a promising approach for continual learning in decision-making tasks. This approach addresses the problem of catastrophic forgetting by leveraging the generation of trajectories from previously encountered tasks to augment the current dataset. However, existing deep generative replay methods for continual learning rely on autoregressive models, which suffer from compounding errors in the generated trajectories. In this paper, we propose a simple, scalable, and non-autoregressive method for continual learning in decision-making tasks using a generative model that generates task samples conditioned on the trajectory timestep. We evaluate our method on Continual World benchmarks and find that our approach achieves state-of-the-art performance on the average success rate metric among continual learning methods. Code is available at https://github.com/WilliamYue37/t-DGR.

📄 PDF Abstract BibTeX arXiv:2401.02576

Code (1)

williamyue37/t-dgr 공식 구현 pytorch

Tasks

Continual Learning Decision Making

Stable Continual Reinforcement Learning via Diffusion-based Trajectory Replay

2024-11-16 · Feng Chen, Fuguang Han, Cong Guan, Lei Yuan 외

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making ta…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Three continual learning scenarios and a case for generative replay

2018-09-27 · Gido M. van de Ven, Andreas S. Tolias

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning problematic. Recently, numerous methods have been proposed for continual learning, bu…

Continual Learning Lifelong learning Permuted-MNIST

Continual Learning for non-stationary regression via Memory-Efficient Replay

2026-02-10 · Pablo García-Santaclara, Bruno Fernández-Castro, RebecaP. Díaz-Redondo, Martín Alonso-Gamarra arxiv

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequ…

Continual Learning

Generative replay with feedback connections as a general strategy for continual learning

2018-09-27 · Gido M. van de Ven, Andreas S. Tolias

A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new o…