paper-with-me

Papers

Posterior temperature optimized Bayesian models for inverse problems in medical imaging

2022-02-02 · Max-Heinrich Laves, Malte Tölle, Alexander Schlaefer, Sandy Engelhardt

We present Posterior Temperature Optimized Bayesian Inverse Models (POTOBIM), an unsupervised Bayesian approach to inverse problems in medical imaging using mean-field variational inference with a fully tempered posterior. Bayesian methods exhibit useful properties for approaching inverse tasks, such as tomographic reconstruction or image denoising. A suitable prior distribution introduces regularization, which is needed to solve the ill-posed problem and reduces overfitting the data. In practice, however, this often results in a suboptimal posterior temperature, and the full potential of the Bayesian approach is not being exploited. In POTOBIM, we optimize both the parameters of the prior distribution and the posterior temperature with respect to reconstruction accuracy using Bayesian optimization with Gaussian process regression. Our method is extensively evaluated on four different inverse tasks on a variety of modalities with images from public data sets and we demonstrate that an optimized posterior temperature outperforms both non-Bayesian and Bayesian approaches without temperature optimization. The use of an optimized prior distribution and posterior temperature leads to improved accuracy and uncertainty estimation and we show that it is sufficient to find these hyperparameters per task domain. Well-tempered posteriors yield calibrated uncertainty, which increases the reliability in the predictions. Our source code is publicly available at github.com/Cardio-AI/mfvi-dip-mia.

📄 PDF Abstract BibTeX arXiv:2202.00986

Code (1)

cardio-ai/mfvi-dip-mia 공식 구현 pytorch

Tasks

Bayesian OptimizationDenoisingImage DenoisingVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Posterior Temperature Optimization in Variational Inference for Inverse Problems

2021-06-11 · Max-Heinrich Laves, Malte Tölle, Alexander Schlaefer, Sandy Engelhardt

Bayesian methods feature useful properties for solving inverse problems, such as tomographic reconstruction. The prior distribution introduces regularization, which helps solving the ill-posed problem and reduces overfit…

Bayesian OptimizationCT ReconstructionDenoisingVariational Inference

A tutorial on the Bayesian statistical approach to inverse problems

2023-04-15 · Faaiq G. Waqar, Swati Patel, Cory M. Simon

Inverse problems are ubiquitous in the sciences and engineering. Two categories of inverse problems concerning a physical system are (1) estimate parameters in a model of the system from observed input-output pairs and (…

On Cold Posteriors of Probabilistic Neural Networks: Understanding the Cold Posterior Effect and A New Way to Learn Cold Posteriors with Tight Generalization Guarantees

2024-10-20 · Yijie Zhang

Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural networ…

Bayesian InferenceGeneralization Bounds

Monte Carlo guided Diffusion for Bayesian linear inverse problems

2023-08-15 · Gabriel Cardoso, Yazid Janati El Idrissi, Sylvain Le Corff, Eric Moulines

Ill-posed linear inverse problems arise frequently in various applications, from computational photography to medical imaging. A recent line of research exploits Bayesian inference with informative priors to handle the i…

Bayesian Inference

Proximal Residual Flows for Bayesian Inverse Problems

2022-11-30 · Johannes Hertrich

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of nor…

Density Estimation