paper-with-me

Papers

ASPIRE: Iterative Amortized Posterior Inference for Bayesian Inverse Problems

2024-05-08 · Rafael Orozco, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances in machine learning and variational inference (VI) have lowered the computational barrier by learning from examples. Two VI paradigms have emerged that represent different tradeoffs: amortized and non-amortized. Amortized VI can produce fast results but due to generalizing to many observed datasets it produces suboptimal inference results. Non-amortized VI is slower at inference but finds better posterior approximations since it is specialized towards a single observed dataset. Current amortized VI techniques run into a sub-optimality wall that can not be improved without more expressive neural networks or extra training data. We present a solution that enables iterative improvement of amortized posteriors that uses the same networks architectures and training data. The benefits of our method requires extra computations but these remain frugal since they are based on physics-hybrid methods and summary statistics. Importantly, these computations remain mostly offline thus our method maintains cheap and reusable online evaluation while bridging the approximation gap these two paradigms. We denote our proposed method ASPIRE - Amortized posteriors with Summaries that are Physics-based and Iteratively REfined. We first validate our method on a stylized problem with a known posterior then demonstrate its practical use on a high-dimensional and nonlinear transcranial medical imaging problem with ultrasound. Compared with the baseline and previous methods from the literature our method stands out as an computationally efficient and high-fidelity method for posterior inference.

📄 PDF Abstract BibTeX arXiv:2405.05398

Code (1)

slimgroup/aspire.jl 공식 구현

Tasks

Uncertainty QuantificationVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Adversarial robustness of amortized Bayesian inference

2023-05-24 · Manuel Glöckler, Michael Deistler, Jakob H. Macke

Bayesian inference usually requires running potentially costly inference procedures separately for every new observation. In contrast, the idea of amortized Bayesian inference is to initially invest computational cost in…

Adversarial RobustnessBayesian Inference

Refining Amortized Posterior Approximations using Gradient-Based Summary Statistics

2023-05-15 · Rafael Orozco, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoret…

Image ReconstructionVariational Inference

JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models

2023-02-17 · Stefan T. Radev, Marvin Schmitt, Valentin Pratz, Umberto Picchini 외

This work proposes ``jointly amortized neural approximation'' (JANA) of intractable likelihood functions and posterior densities arising in Bayesian surrogate modeling and simulation-based inference. We train three compl…

DiagnosticTime SeriesTime Series Analysis

Identifiability and amortized inference limitations in Kuramoto models

2026-03-23 · Emma Hannula, Jana de Wiljes, Matthew T. Moores, Heikki Haario 외 arxiv

Bayesian inference is a powerful tool for parameter estimation and uncertainty quantification in dynamical systems. However, for nonlinear oscillator networks such as Kuramoto models, widely used to study synchronization…

Bayesian Inference

Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models

2025-05-13 · Stefania Scheurer, Philipp Reiser, Tim Brünnette, Wolfgang Nowak 외

Bayesian inference typically relies on a large number of model evaluations to estimate posterior distributions. Established methods like Markov Chain Monte Carlo (MCMC) and Amortized Bayesian Inference (ABI) can become c…

Bayesian Inference