paper-with-me

홈 › Papers

LazyDINO: Fast, scalable, and efficiently amortized Bayesian inversion via structure-exploiting and surrogate-driven measure transport

2024-11-19 · Lianghao Cao, Joshua Chen, Michael Brennan, Thomas O'Leary-Roseberry, Youssef Marzouk, Omar Ghattas

We present LazyDINO, a transport map variational inference method for fast, scalable, and efficiently amortized solutions of high-dimensional nonlinear Bayesian inverse problems with expensive parameter-to-observable (PtO) maps. Our method consists of an offline phase in which we construct a derivative-informed neural surrogate of the PtO map using joint samples of the PtO map and its Jacobian. During the online phase, when given observational data, we seek rapid posterior approximation using surrogate-driven training of a lazy map [Brennan et al., NeurIPS, (2020)], i.e., a structure-exploiting transport map with low-dimensional nonlinearity. The trained lazy map then produces approximate posterior samples or density evaluations. Our surrogate construction is optimized for amortized Bayesian inversion using lazy map variational inference. We show that (i) the derivative-based reduced basis architecture [O'Leary-Roseberry et al., Comput. Methods Appl. Mech. Eng., 388 (2022)] minimizes the upper bound on the expected error in surrogate posterior approximation, and (ii) the derivative-informed training formulation [O'Leary-Roseberry et al., J. Comput. Phys., 496 (2024)] minimizes the expected error due to surrogate-driven transport map optimization. Our numerical results demonstrate that LazyDINO is highly efficient in cost amortization for Bayesian inversion. We observe one to two orders of magnitude reduction of offline cost for accurate posterior approximation, compared to simulation-based amortized inference via conditional transport and conventional surrogate-driven transport. In particular, LazyDINO outperforms Laplace approximation consistently using fewer than 1000 offline samples, while other amortized inference methods struggle and sometimes fail at 16,000 offline samples.

📄 PDF Abstract BibTeX arXiv:2411.12726

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Identifiability and amortized inference limitations in Kuramoto models

2026-03-23 · Emma Hannula, Jana de Wiljes, Matthew T. Moores, Heikki Haario 외 arxiv

Bayesian inference is a powerful tool for parameter estimation and uncertainty quantification in dynamical systems. However, for nonlinear oscillator networks such as Kuramoto models, widely used to study synchronization…

Bayesian Inference

Amortized Bayesian Local Interpolation NetworK: Fast covariance parameter estimation for Gaussian Processes

2024-11-10 · Brandon R. Feng, Reetam Majumder, Brian J. Reich, Mohamed A. Abba

Gaussian processes (GPs) are a ubiquitous tool for geostatistical modeling with high levels of flexibility and interpretability, and the ability to make predictions at unseen spatial locations through a process called Kr…

Computational EfficiencyGaussian Processesparameter estimation

Scalable Bayesian Inference for Detection and Deblending in Astronomical Images

2022-07-12 · Derek Hansen, Ismael Mendoza, Runjing Liu, Ziteng Pang 외

We present a new probabilistic method for detecting, deblending, and cataloging astronomical sources called the Bayesian Light Source Separator (BLISS). BLISS is based on deep generative models, which embed neural networ…

Bayesian InferenceGPUVariational Inference

Improving the Accuracy of Amortized Model Comparison with Self-Consistency

2025-12-16 · Šimon Kucharský, Aayush Mishra, Daniel Habermann, Stefan T. Radev 외 arxiv

Amortized Bayesian inference (ABI) offers fast, scalable approximations to posterior densities by training neural surrogates on data simulated from the statistical model. However, ABI methods are highly sensitive to mode…

Bayesian Inference

Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison

2023-05-18 · Niall Jeffrey, Benjamin D. Wandelt

Evidence Networks can enable Bayesian model comparison when state-of-the-art methods (e.g. nested sampling) fail and even when likelihoods or priors are intractable or unknown. Bayesian model comparison, i.e. the computa…

Density Estimation