paper-with-me

Papers

pymdp: A Python library for active inference in discrete state spaces

2022-01-11 · Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl Friston, Iain Couzin, Alexander Tschantz

Active inference is an account of cognition and behavior in complex systems which brings together action, perception, and learning under the theoretical mantle of Bayesian inference. Active inference has seen growing applications in academic research, especially in fields that seek to model human or animal behavior. While in recent years, some of the code arising from the active inference literature has been written in open source languages like Python and Julia, to-date, the most popular software for simulating active inference agents is the DEM toolbox of SPM, a MATLAB library originally developed for the statistical analysis and modelling of neuroimaging data. Increasing interest in active inference, manifested both in terms of sheer number as well as diversifying applications across scientific disciplines, has thus created a need for generic, widely-available, and user-friendly code for simulating active inference in open-source scientific computing languages like Python. The Python package we present here, pymdp (see https://github.com/infer-actively/pymdp), represents a significant step in this direction: namely, we provide the first open-source package for simulating active inference with partially-observable Markov Decision Processes or POMDPs. We review the package's structure and explain its advantages like modular design and customizability, while providing in-text code blocks along the way to demonstrate how it can be used to build and run active inference processes with ease. We developed pymdp to increase the accessibility and exposure of the active inference framework to researchers, engineers, and developers with diverse disciplinary backgrounds. In the spirit of open-source software, we also hope that it spurs new innovation, development, and collaboration in the growing active inference community.

📄 PDF Abstract BibTeX arXiv:2201.03904

Code (1)

infer-actively/pymdp 공식 구현 jax

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

A Concise Mathematical Description of Active Inference in Discrete Time

2024-06-11 · Jesse van Oostrum, Carlotta Langer, Nihat Ay

In this paper we present a concise mathematical description of active inference in discrete time. The main part of the paper serves as a basic introduction to the topic, including a detailed example of the action selecti…

A Hardware-oriented Approach for Efficient Active Inference Computation and Deployment

2025-08-12 · Nikola Pižurica, Nikola Milović, Igor Jovančević, Conor Heins 외 arxiv

Active Inference (AIF) offers a robust framework for decision-making, yet its computational and memory demands pose challenges for deployment, especially in resource-constrained environments. This work presents a methodo…

LINFA: a Python library for variational inference with normalizing flow and annealing

2023-07-10 · Yu Wang, Emma R. Cobian, Jubilee Lee, Fang Liu 외

Variational inference is an increasingly popular method in statistics and machine learning for approximating probability distributions. We developed LINFA (Library for Inference with Normalizing Flow and Annealing), a Py…

Variational Inference

srlearn: A Python Library for Gradient-Boosted Statistical Relational Models

2019-12-17 · Alexander L. Hayes

We present srlearn, a Python library for boosted statistical relational models. We adapt the scikit-learn interface to this setting and provide examples for how this can be used to express learning and inference problems…

Continual Inference: A Library for Efficient Online Inference with Deep Neural Networks in PyTorch

2022-04-07 · Lukas Hedegaard, Alexandros Iosifidis

We present Continual Inference, a Python library for implementing Continual Inference Networks (CINs) in PyTorch, a class of Neural Networks designed specifically for efficient inference in both online and batch processi…