paper-with-me

Papers

Diffusion models for probabilistic programming

2023-11-01 · Simon Dirmeier, Fernando Perez-Cruz

We propose Diffusion Model Variational Inference (DMVI), a novel method for automated approximate inference in probabilistic programming languages (PPLs). DMVI utilizes diffusion models as variational approximations to the true posterior distribution by deriving a novel bound to the marginal likelihood objective used in Bayesian modelling. DMVI is easy to implement, allows hassle-free inference in PPLs without the drawbacks of, e.g., variational inference using normalizing flows, and does not make any constraints on the underlying neural network model. We evaluate DMVI on a set of common Bayesian models and show that its posterior inferences are in general more accurate than those of contemporary methods used in PPLs while having a similar computational cost and requiring less manual tuning.

📄 PDF Abstract BibTeX arXiv:2311.00474

Code (1)

dirmeier/dmvi 공식 구현 jax

Tasks

Probabilistic ProgrammingVariational Inference

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Variational Inference 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Deployable probabilistic programming

2019-06-20 · David Tolpin

We propose design guidelines for a probabilistic programming facility suitable for deployment as a part of a production software system. As a reference implementation, we introduce Infergo, a probabilistic programming fa…

Decision MakingProbabilistic Programming

A Compilation Target for Probabilistic Programming Languages

2014-03-03 · Brooks Paige, Frank Wood

Forward inference techniques such as sequential Monte Carlo and particle Markov chain Monte Carlo for probabilistic programming can be implemented in any programming language by creative use of standardized operating sys…

Probabilistic Programming

Deep Probabilistic Programming Languages: A Qualitative Study

2018-04-17 · Guillaume Baudart, Martin Hirzel, Louis Mandel

Deep probabilistic programming languages try to combine the advantages of deep learning with those of probabilistic programming languages. If successful, this would be a big step forward in machine learning and programmi…

BIG-bench Machine LearningProbabilistic Programming

Automated learning with a probabilistic programming language: Birch

2018-10-02 · Lawrence M. Murray, Thomas B. Schön

This work offers a broad perspective on probabilistic modeling and inference in light of recent advances in probabilistic programming, in which models are formally expressed in Turing-complete programming languages. We c…

FormMultiple Object TrackingObject TrackingProbabilistic Programming

Program Analysis of Probabilistic Programs

2022-04-14 · Maria I. Gorinova

Probabilistic programming is a growing area that strives to make statistical analysis more accessible, by separating probabilistic modelling from probabilistic inference. In practice this decoupling is difficult. No sing…

Probabilistic Programming