paper-with-me

홈 › Papers

Reinforcement Learning through Active Inference

2020-02-28 · Alexander Tschantz, Beren Millidge, Anil. K. Seth, Christopher L. Buckley

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act to maximize the evidence for a biased generative model. Here, we illustrate how ideas from active inference can augment traditional RL approaches by (i) furnishing an inherent balance of exploration and exploitation, and (ii) providing a more flexible conceptualization of reward. Inspired by active inference, we develop and implement a novel objective for decision making, which we term the free energy of the expected future. We demonstrate that the resulting algorithm successfully balances exploration and exploitation, simultaneously achieving robust performance on several challenging RL benchmarks with sparse, well-shaped, and no rewards.

📄 PDF Abstract BibTeX arXiv:2002.12636

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Reward Maximisation through Discrete Active Inference

2020-09-17 · Lancelot Da Costa, Noor Sajid, Thomas Parr, Karl Friston 외

Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully …

Decision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1

Deep Active Inference as Variational Policy Gradients

2019-07-08 · Beren Millidge

Active Inference is a theory of action arising from neuroscience which casts action and planning as a bayesian inference problem to be solved by minimizing a single quantity - the variational free energy. Active Inferenc…

Bayesian Inferencereinforcement-learningReinforcement LearningReinforcement Learning (RL)

On the Relationship Between Active Inference and Control as Inference

2020-06-23 · Beren Millidge, Alexander Tschantz, Anil. K. Seth, Christopher L. Buckley

Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforc…

Decision Makingreinforcement-learningReinforcement Learning (RL)Variational Inference

Active inference: demystified and compared

2019-09-24 · Noor Sajid, Philip J. Ball, Thomas Parr, Karl J. Friston

Active inference is a first principle account of how autonomous agents operate in dynamic, non-stationary environments. This problem is also considered in reinforcement learning (RL), but limited work exists on comparing…

Atari GamesOpenAI GymQ-LearningReinforcement Learning+1

Demonstrating the Continual Learning Capabilities and Practical Application of Discrete-Time Active Inference

2024-09-30 · Rithvik Prakki

Active inference is a mathematical framework for understanding how agents (biological or artificial) interact with their environments, enabling continual adaptation and decision-making. It combines Bayesian inference and…

Bayesian InferenceContinual LearningDecision MakingSelf-Learning