paper-with-me

Papers

Online Generalised Predictive Coding

2026-05-04 · Mehran H. Z. Bazargani, Szymon Urbas, Adeel Razi, Thomas Brendan Murphy, Karl Friston arxiv

This paper introduces an extension of generalised filtering for online applications. Generalised filtering refers to data assimilation schemes that jointly infer latent states, learn unknown model parameters, and estimate uncertainty in an integrated framework -- e.g., estimate state and observation noise -- at the same time (i.e., triple estimation). This framework appears across disciplines under different names, including variational Kalman-Bucy filtering in engineering, generalised predictive coding in neuroscience, and Dynamic Expectation Maximisation (DEM) in time-series analysis. Here, we specialise DEM for ``online'' data assimilation, through a separation of temporal scales. We describe the variational principles and procedures that allow one to assimilate data in a way that allows for a slow updating of parameters and precisions, which contextualise fast Bayesian belief updating about the dynamic hidden states. Using numerical studies, we demonstrate the validity of online DEM (ODEM) using a non-linear -- and potentially chaotic -- generative model, to show that the ODEM scheme can track the latent states of the generative process, even when its functional form differs fundamentally from the dynamics of the generative model. Framed from a neuro-mimetic predictive coding perspective, ODEM offers a biologically inspired solution to online inference, learning, and uncertainty estimation in dynamic environments.

📄 PDF Abstract BibTeX arXiv:2605.02675

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A generalised log-determinant regularizer for online semi-definite programming and its applications

2020-12-10 · Yaxiong Liu, Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto

We consider a variant of online semi-definite programming problem (OSDP): The decision space consists of semi-definite matrices with bounded $\Gamma$-trace norm, which is a generalization of trace norm defined by a posit…

Matrix Completion

How to Leverage Predictive Uncertainty Estimates for Reducing Catastrophic Forgetting in Online Continual Learning

2024-07-10 · Giuseppe Serra, Ben Werner, Florian Buettner

Many real-world applications require machine-learning models to be able to deal with non-stationary data distributions and thus learn autonomously over an extended period of time, often in an online setting. One of the m…

Continual Learning

Differentiable Generalised Predictive Coding

2021-12-02 · André Ofner, Sebastian Stober

This paper deals with differentiable dynamical models congruent with neural process theories that cast brain function as the hierarchical refinement of an internal generative model explaining observations. Our work exten…

Predictively Oriented Posteriors

2025-10-02 · Yann McLatchie, Badr-Eddine Cherief-Abdellatif, David T. Frazier, Jeremias Knoblauch arxiv

We advocate for a new statistical principle that combines the most desirable aspects of both parameter inference and density estimation. This leads us to the predictively oriented (PrO) posterior, which expresses uncerta…

Density Estimation

Machine Learning with High-Cardinality Categorical Features in Actuarial Applications

2023-01-30 · Benjamin Avanzi, Greg Taylor, Melantha Wang, Bernard Wong

High-cardinality categorical features are pervasive in actuarial data (e.g. occupation in commercial property insurance). Standard categorical encoding methods like one-hot encoding are inadequate in these settings. In t…

Vocal Bursts Intensity Prediction