Learning and Querying Fast Generative Models for Reinforcement Learning
A key challenge in model-based reinforcement learning (RL) is to synthesize computationally efficient and accurate environment models. We show that carefully designed generative models that learn and operate on compact state representations, so-called state-space models, substantially reduce the computational costs for predicting outcomes of sequences of actions. Extensive experiments establish that state-space models accurately capture the dynamics of Atari games from the Arcade Learning Environment from raw pixels. The computational speed-up of state-space models while maintaining high accuracy makes their application in RL feasible: We demonstrate that agents which query these models for decision making outperform strong model-free baselines on the game MSPACMAN, demonstrating the potential of using learned environment models for planning.
Code (0)
등록된 구현이 없습니다.
Tasks
Atari GamesDecision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)State Space ModelsSimilar Papers 제목 키워드 기반
Selective Progress-Aware Querying for Human-in-the-Loop Reinforcement Learning
Human feedback can greatly accelerate robot learning, but in real-world settings, such feedback is costly and limited. Existing human-in-the-loop reinforcement learning (HiL-RL) methods often assume abundant feedback, li…
Reinforcement LearningGenerative Active Learning for Image Synthesis Personalization
This paper presents a pilot study that explores the application of active learning, traditionally studied in the context of discriminative models, to generative models. We specifically focus on image synthesis personaliz…
Active LearningImage GenerationL-SA: Learning Under-Explored Targets in Multi-Target Reinforcement Learning
Tasks that involve interaction with various targets are called multi-target tasks. When applying general reinforcement learning approaches for such tasks, certain targets that are difficult to access or interact with may…
General Reinforcement Learningreinforcement-learningVisual NavigationEfficient Meta Reinforcement Learning for Preference-based Fast Adaptation
Learning new task-specific skills from a few trials is a fundamental challenge for artificial intelligence. Meta reinforcement learning (meta-RL) tackles this problem by learning transferable policies that support few-sh…
Meta Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Enhancing Knowledge Retrieval with In-Context Learning and Semantic Search through Generative AI
Retrieving and extracting knowledge from extensive research documents and large databases presents significant challenges for researchers, students, and professionals in today's information-rich era. Existing retrieval s…
In-Context LearningInformation RetrievalRetrievalText Retrieval