Reinforcement Learning through Active Inference
The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act to maximize the evidence for a biased generative model. Here, we illustrate how ideas from active inference can augment traditional RL approaches by (i) furnishing an inherent balance of exploration and exploitation, and (ii) providing a more flexible conceptualization of reward. Inspired by active inference, we develop and implement a novel objective for decision making, which we term the free energy of the expected future. We demonstrate that the resulting algorithm successfully balances exploration and exploitation, simultaneously achieving robust performance on several challenging RL benchmarks with sparse, well-shaped, and no rewards.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Reward Maximisation through Discrete Active Inference
Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully …
Decision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1Deep Active Inference as Variational Policy Gradients
Active Inference is a theory of action arising from neuroscience which casts action and planning as a bayesian inference problem to be solved by minimizing a single quantity - the variational free energy. Active Inferenc…
Bayesian Inferencereinforcement-learningReinforcement LearningReinforcement Learning (RL)On the Relationship Between Active Inference and Control as Inference
Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforc…
Decision Makingreinforcement-learningReinforcement Learning (RL)Variational InferenceActive inference: demystified and compared
Active inference is a first principle account of how autonomous agents operate in dynamic, non-stationary environments. This problem is also considered in reinforcement learning (RL), but limited work exists on comparing…
Atari GamesOpenAI GymQ-LearningReinforcement Learning+1Demonstrating the Continual Learning Capabilities and Practical Application of Discrete-Time Active Inference
Active inference is a mathematical framework for understanding how agents (biological or artificial) interact with their environments, enabling continual adaptation and decision-making. It combines Bayesian inference and…
Bayesian InferenceContinual LearningDecision MakingSelf-Learning