World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays
Going beyond predicting robot actions, World Action Models (WAMs) can also generate future visual observations. We build on this generative capability to propose Recurrent Generative Replay (REGEN), a continual imitation learning framework that synthesizes pseudo-replay trajectories, enabling a robot policy to rehearse previously learned tasks without storing their original human demonstrations. During continual adaptation, REGEN recursively queries the WAM to synthesize pseudo-replay trajectories conditioned only on prior task instructions and current-task observations. Experiments in both simulation and real-world manipulation settings show that REGEN reduces catastrophic forgetting by up to $50\%$ relative to sequential fine-tuning, while approaching the performance of privileged experience replay methods that require access to real replay data. Finally, we analyze the factors limiting generated replay, identifying long-horizon visual degradation and action-observation inconsistency as the primary bottlenecks. Our results establish WAMs as a promising foundation for continual robot learning without stored demonstrations.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Task-Agnostic Continual Reinforcement Learning: Gaining Insights and Overcoming Challenges
Continual learning (CL) enables the development of models and agents that learn from a sequence of tasks while addressing the limitations of standard deep learning approaches, such as catastrophic forgetting. In this wor…
Continual LearningContinuous ControlMulti-Task Learningreinforcement-learning+2Recurrent Knowledge Identification and Fusion for Language Model Continual Learning
Continual learning (CL) is crucial for deploying large language models (LLMs) in dynamic real-world environments without costly retraining. While recent model ensemble and model merging methods guided by parameter import…
Continual LearningLanguage ModelingLanguage ModellingTransfer LearningSPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation
Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks. Traditional imitation learning relies on static training paradigms, which are ill-s…
Action GenerationImitation LearningRobot ManipulationTransfer LearningFrom Eye-blinks to State Construction: Diagnostic Benchmarks for Online Representation Learning
We present three new diagnostic prediction problems inspired by classical-conditioning experiments to facilitate research in online prediction learning. Experiments in classical conditioning show that animals such as rab…
Continual LearningDiagnosticPredictionRepresentation LearningThe Need for a Big World Simulator: A Scientific Challenge for Continual Learning
The "small agent, big world" frame offers a conceptual view that motivates the need for continual learning. The idea is that a small agent operating in a much bigger world cannot store all information that the world has …
Continual Learning