Image Augmentation Based Momentum Memory Intrinsic Reward for Sparse Reward Visual Scenes
Many scenes in real life can be abstracted to the sparse reward visual scenes, where it is difficult for an agent to tackle the task under the condition of only accepting images and sparse rewards. We propose to decompose this problem into two sub-problems: the visual representation and the sparse reward. To address them, a novel framework IAMMIR combining the self-supervised representation learning with the intrinsic motivation is presented. For visual representation, a representation driven by a combination of the imageaugmented forward dynamics and the reward is acquired. For sparse rewards, a new type of intrinsic reward is designed, the Momentum Memory Intrinsic Reward (MMIR). It utilizes the difference of the outputs from the current model (online network) and the historical model (target network) to present the agent's state familiarity. Our method is evaluated on the visual navigation task with sparse rewards in Vizdoom. Experiments demonstrate that our method achieves the state of the art performance in sample efficiency, at least 2 times faster than the existing methods reaching 100% success rate.
Code (0)
등록된 구현이 없습니다.
Tasks
Image AugmentationRepresentation LearningVisual NavigationSimilar Papers 제목 키워드 기반
Improving Text-to-Image Generation with Intrinsic Self-Confidence Rewards
Text-to-image generation powers content creation across design, media, and data augmentation. Post-training of text-to-image generative models is a promising path to improve human preference alignment, factuality, and ae…
Text-to-Image GenerationReinforcement LearningData AugmentationMomentum for Reasoning: Dense Intrinsic Signals in Policy Optimization
Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for eliciting long-chain reasoning in large language models. However, existing methods based on Group Relative Policy Optimization …
Reinforcement LearningMathematical ReasoningGo Beyond Imagination: Maximizing Episodic Reachability with World Models
Efficient exploration is a challenging topic in reinforcement learning, especially for sparse reward tasks. To deal with the reward sparsity, people commonly apply intrinsic rewards to motivate agents to explore the stat…
Efficient ExplorationBeyond Surprise: Improving Exploration Through Surprise Novelty
We present a new computing model for intrinsic rewards in reinforcement learning that addresses the limitations of existing surprise-driven explorations. The reward is the novelty of the surprise rather than the surprise…
Atari GamesRetrievalDynamic Memory-based Curiosity: A Bootstrap Approach for Exploration
The sparsity of extrinsic rewards poses a serious challenge for reinforcement learning (RL). Currently, many efforts have been made on curiosity which can provide a representative intrinsic reward for effective explorati…
Reinforcement Learning (RL)