paper-with-me

홈 › Papers

Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior

2023-09-05 · Berthy T. Feng, Katherine L. Bouman

We propose a surrogate function for efficient yet principled use of score-based priors in Bayesian imaging. We consider ill-posed inverse imaging problems in which one aims for a clean image posterior given incomplete or noisy measurements. Since the measurements do not uniquely determine a true image, a prior is needed to constrain the solution space. Recent work turned score-based diffusion models into principled priors for solving ill-posed imaging problems by appealing to an ODE-based log-probability function. However, evaluating the ODE is computationally inefficient and inhibits posterior estimation of high-dimensional images. Our proposed surrogate prior is based on the evidence lower bound of a score-based diffusion model. We demonstrate the surrogate prior on variational inference for efficient approximate posterior sampling of large images. Compared to the exact prior in previous work, our surrogate accelerates optimization of the variational image distribution by at least two orders of magnitude. We also find that our principled approach gives more accurate posterior estimation than non-variational diffusion-based approaches that involve hyperparameter-tuning at inference. Our work establishes a practical path forward for using score-based diffusion models as general-purpose image priors.

📄 PDF Abstract BibTeX arXiv:2309.01949

Code (1)

berthyf96/score_prior 공식 구현 jax

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Variational Bayesian surrogate modelling with application to robust design optimisation

2024-04-23 · Thomas A. Archbold, Ieva Kazlauskaite, Fehmi Cirak

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are…

Bayesian InferenceDimensionality ReductionRobust Design

Semi-Implicit Variational Inference via Score Matching

2023-08-19 · Longlin Yu, Cheng Zhang

Semi-implicit variational inference (SIVI) greatly enriches the expressiveness of variational families by considering implicit variational distributions defined in a hierarchical manner. However, due to the intractable d…

Bayesian InferenceDenoisingVariational Inference

Variational Hamiltonian Monte Carlo via Score Matching

2016-02-06 · Cheng Zhang, Babak Shahbaba, Hongkai Zhao

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been propose…

Bayesian InferenceComputational Efficiency

Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion

2018-07-11 · Steven Atkinson, Nicholas Zabaras

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to …

Dimensionality Reduction

Latent Diffusion Posterior Sampling with Surrogate Likelihood Guidance for PDE Inverse Problems

2026-06-25 · Yuanzhe Wang, Alexandre M. Tartakovsky arxiv

We propose latent-space diffusion posterior sampling (L-DPS), an approximate Bayesian framework for high-dimensional inverse problems governed by partial differential equations (PDEs). The method addresses three challeng…