Representation Learning in Partially Observable Environments using Sensorimotor Prediction
In order to explore and act autonomously in an environment, an agent needs to learn from the sensorimotor information that is captured while acting. By extracting the regularities in this sensorimotor stream, it can learn a model of the world, which in turn can be used as a basis for action and exploration. This requires the acquisition of compact representations from a possibly high dimensional raw observation, which is noisy and ambiguous. In this paper, we learn sensory representations from sensorimotor prediction. We propose a model which integrates sensorimotor information over time, and project it in a sensory representation which is useful for prediction. We emphasize on a simple example the role of motor and memory for learning sensory representations.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionRepresentation LearningSimilar Papers 제목 키워드 기반
Context Discovery for Model Learning in Partially Observable Environments
The ability to learn a model is essential for the success of autonomous agents. Unfortunately, learning a model is difficult in partially observable environments, where latent environmental factors influence what the age…
Future Prediction Can be a Strong Evidence of Good History Representation in Partially Observable Environments
Learning a good history representation is one of the core challenges of reinforcement learning (RL) in partially observable environments. Recent works have shown the advantages of various auxiliary tasks for facilitating…
Future predictionMemorizationPredictionreinforcement-learning+3Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments
Navigating complex and dynamic environments requires autonomous vehicles (AVs) to reason about both visible and occluded regions. This involves predicting the future motion of observed agents, inferring occluded ones, an…
Autonomous VehiclesPredictionTrajectory PredictionActive Vision Reinforcement Learning under Limited Visual Observability
In this work, we investigate Active Vision Reinforcement Learning (ActiveVision-RL), where an embodied agent simultaneously learns action policy for the task while also controlling its visual observations in partially ob…
reinforcement-learningReinforcement LearningLearning Partially Observable Models Using Temporally Abstract Decision Trees
This paper introduces timeline trees, which are partial models of partially observable environments. Timeline trees are given some specific predictions to make and learn a decision tree over history. The main idea of tim…