paper-with-me

홈 › Papers

From pixels to planning: scale-free active inference

2024-07-27 · Karl Friston, Conor Heins, Tim Verbelen, Lancelot Da Costa, Tommaso Salvatori, Dimitrije Markovic, Alexander Tschantz, Magnus Koudahl, Christopher Buckley, Thomas Parr

This paper describes a discrete state-space model -- and accompanying methods -- for generative modelling. This model generalises partially observed Markov decision processes to include paths as latent variables, rendering it suitable for active inference and learning in a dynamic setting. Specifically, we consider deep or hierarchical forms using the renormalisation group. The ensuing renormalising generative models (RGM) can be regarded as discrete homologues of deep convolutional neural networks or continuous state-space models in generalised coordinates of motion. By construction, these scale-invariant models can be used to learn compositionality over space and time, furnishing models of paths or orbits; i.e., events of increasing temporal depth and itinerancy. This technical note illustrates the automatic discovery, learning and deployment of RGMs using a series of applications. We start with image classification and then consider the compression and generation of movies and music. Finally, we apply the same variational principles to the learning of Atari-like games.

📄 PDF Abstract BibTeX arXiv:2407.20292

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage ClassificationState Space Models

Similar Papers 제목 키워드 기반

Hierarchical Active Inference using Successor Representations

2026-04-17 · Prashant Rangarajan, Rajesh P. N. Rao arxiv

Active inference, a neurally-inspired model for inferring actions based on the free energy principle (FEP), has been proposed as a unifying framework for understanding perception, action, and learning in the brain. Activ…

Reinforcement Learning

What Type of Inference is Active Inference?

2026-06-03 · Wouter W. L. Nuijten, Mykola Lukashchuk, Thijs van de Laar, Bert de Vries arxiv

Active inference casts decision-making as inference, with the Expected Free Energy (EFE) unifying goal-directed and information-seeking behavior. Recent work showed that EFE minimization can be written as Variational Fre…

Active Inference in String Diagrams: A Categorical Account of Predictive Processing and Free Energy

2023-08-01 · Sean Tull, Johannes Kleiner, Toby St Clere Smithe

We present a categorical formulation of the cognitive frameworks of Predictive Processing and Active Inference, expressed in terms of string diagrams interpreted in a monoidal category with copying and discarding. This i…

Successor Representation Active Inference

2022-07-20 · Beren Millidge, Christopher L Buckley

Recent work has uncovered close links between between classical reinforcement learning algorithms, Bayesian filtering, and Active Inference which lets us understand value functions in terms of Bayesian posteriors. An alt…

Reinforcement Learning (RL)

Expected Free Energy-based Planning as Variational Inference

2025-04-21 · Bert de Vries, Wouter Nuijten, Thijs van de Laar, Wouter Kouw 외

We address the problem of planning under uncertainty, where an agent must choose actions that not only achieve desired outcomes but also reduce uncertainty. Traditional methods often treat exploration and exploitation as…

Variational Inference