paper-with-me

홈 › Papers

Probabilistic Deep Learning with Generalised Variational Inference

2021-11-22 · pproximateinference AABI Symposium 2022 2 · Giorgos Felekis, Theo Damoulas, Brooks Paige

We study probabilistic Deep Learning methods through the lens of Approximate Bayesian Inference. In particular, we examine Bayesian Neural Networks (BNNs), which usually suffer from multiple ill-posed assumptions such as prior and likelihood misspecification. In this direction, we investigate a recently proposed approximate inference framework called Generalised Variational Inference (GVI) in comparison to state-of-the-art methods including standard Variational Inference, Monte-Carlo Dropout, Stochastic gradient Langevin dynamics and Deep Ensembles. Also, we expand the original research around GVI by exploring a broader set of model architectures and mathematical settings on both real and synthetic data. Our experiments demonstrate that approximate posterior distributions derived from such a method offer attractive properties with respect to uncertainty quantification, prior specification robustness and predictive performance, especially in the case of BNNs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceDeep LearningProbabilistic Deep LearningUncertainty QuantificationVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Deep Ensembles 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Framework

2025-02-02 · Terje Mildner, Oliver Hamelijnck, Paris Giampouras, Theodoros Damoulas

We introduce FedGVI, a probabilistic Federated Learning (FL) framework that is robust to both prior and likelihood misspecification. FedGVI addresses limitations in both frequentist and Bayesian FL by providing unbiased …

Federated LearningUncertainty QuantificationVariational Inference

The Multivariate Generalised von Mises distribution: Inference and applications

2016-02-16 · Alexandre K. W. Navarro, Jes Frellsen, Richard E. Turner

Circular variables arise in a multitude of data-modelling contexts ranging from robotics to the social sciences, but they have been largely overlooked by the machine learning community. This paper partially redresses thi…

Gaussian Processes

Realising Synthetic Active Inference Agents, Part II: Variational Message Updates

2023-06-05 · Thijs van de Laar, Magnus Koudahl, Bert de Vries

The Free Energy Principle (FEP) describes (biological) agents as minimising a variational Free Energy (FE) with respect to a generative model of their environment. Active Inference (AIF) is a corollary of the FEP that de…

Rates of Convergence of Generalised Variational Inference Posteriors under Prior Misspecification

2025-10-03 · Terje Mildner, Paris Giampouras, Theodoros Damoulas arxiv

We prove rates of convergence and robustness to prior misspecification within a Generalised Variational Inference (GVI) framework with bounded divergences. This addresses a significant open challenge for GVI and Federate…

Sparse probabilistic projections

2008-12-01 · NeurIPS 2008 12 · Cédric Archambeau, Francis R. Bach

We present a generative model for performing sparse probabilistic projections, which includes sparse principal component analysis and sparse canonical correlation analysis as special cases. Sparsity is enforced by means …