paper-with-me

홈 › Papers

Integration of Active Learning and MCMC Sampling for Efficient Bayesian Calibration of Mechanical Properties

2024-11-20 · Leon Riccius, Iuri B. C. M. Rocha, Joris Bierkens, Hanne Kekkonen, Frans P. van der Meer

Recent advancements in Markov chain Monte Carlo (MCMC) sampling and surrogate modelling have significantly enhanced the feasibility of Bayesian analysis across engineering fields. However, the selection and integration of surrogate models and cutting-edge MCMC algorithms, often depend on ad-hoc decisions. A systematic assessment of their combined influence on analytical accuracy and efficiency is notably lacking. The present work offers a comprehensive comparative study, employing a scalable case study in computational mechanics focused on the inference of spatially varying material parameters, that sheds light on the impact of methodological choices for surrogate modelling and sampling. We show that a priori training of the surrogate model introduces large errors in the posterior estimation even in low to moderate dimensions. We introduce a simple active learning strategy based on the path of the MCMC algorithm that is superior to all a priori trained models, and determine its training data requirements. We demonstrate that the choice of the MCMC algorithm has only a small influence on the amount of training data but no significant influence on the accuracy of the resulting surrogate model. Further, we show that the accuracy of the posterior estimation largely depends on the surrogate model, but not even a tailored surrogate guarantees convergence of the MCMC.Finally, we identify the forward model as the bottleneck in the inference process, not the MCMC algorithm. While related works focus on employing advanced MCMC algorithms, we demonstrate that the training data requirements render the surrogate modelling approach infeasible before the benefits of these gradient-based MCMC algorithms on cheap models can be reaped.

📄 PDF Abstract BibTeX arXiv:2411.13361

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature

2014-11-03 · NeurIPS 2014 12 · Tom Gunter, Michael A. Osborne, Roman Garnett, Philipp Hennig 외

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central chall…

Active LearningNumerical Integration

Fast fully-reproducible serial/parallel Monte Carlo and MCMC simulations and visualizations via ParaMonte::Python library

2020-10-01 · Amir Shahmoradi, Fatemeh Bagheri, Joshua Alexander Osborne

ParaMonte::Python (standing for Parallel Monte Carlo in Python) is a serial and MPI-parallelized library of (Markov Chain) Monte Carlo (MCMC) routines for sampling mathematical objective functions, in particular, the pos…

Uncertainty Quantification

Large-Scale Distributed Bayesian Matrix Factorization using Stochastic Gradient MCMC

2015-03-05 · Sungjin Ahn, Anoop Korattikara, Nathan Liu, Suju Rajan 외

Despite having various attractive qualities such as high prediction accuracy and the ability to quantify uncertainty and avoid over-fitting, Bayesian Matrix Factorization has not been widely adopted because of the prohib…

Prediction

Subsampling MCMC - An introduction for the survey statistician

2018-07-23 · Matias Quiroz, Mattias Villani, Robert Kohn, Minh-Ngoc Tran 외

The rapid development of computing power and efficient Markov Chain Monte Carlo (MCMC) simulation algorithms have revolutionized Bayesian statistics, making it a highly practical inference method in applied work. However…

SurveySurvey Sampling

Bayesian neural networks via MCMC: a Python-based tutorial

2023-04-02 · Rohitash Chandra, Joshua Simmons

Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain Monte-Carlo (MCMC) sampling methods …

Bayesian InferenceDeep Learningparameter estimationUncertainty Quantification+1