paper-with-me

Papers

Spatial Monte Carlo Integration with Annealed Importance Sampling

2020-12-21 · Muneki Yasuda, Kaiji Sekimoto

Evaluating expectations on an Ising model (or Boltzmann machine) is essential for various applications, including statistical machine learning. However, in general, the evaluation is computationally difficult because it involves intractable multiple summations or integrations; therefore, it requires approximation. Monte Carlo integration (MCI) is a well-known approximation method; a more effective MCI-like approximation method was proposed recently, called spatial Monte Carlo integration (SMCI). However, the estimations obtained using SMCI (and MCI) exhibit a low accuracy in Ising models under a low temperature owing to degradation of the sampling quality. Annealed importance sampling (AIS) is a type of importance sampling based on Markov chain Monte Carlo methods that can suppress performance degradation in low-temperature regions with the force of importance weights. In this study, a new method is proposed to evaluate the expectations on Ising models combining AIS and SMCI. The proposed method performs efficiently in both high- and low-temperature regions, which is demonstrated theoretically and numerically.

📄 PDF Abstract BibTeX arXiv:2012.11198

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Annealed Flow Transport Monte Carlo

2021-02-15 · Michael Arbel, Alexander G. D. G. Matthews, Arnaud Doucet

Annealed Importance Sampling (AIS) and its Sequential Monte Carlo (SMC) extensions are state-of-the-art methods for estimating normalizing constants of probability distributions. We propose here a novel Monte Carlo algor…

Continual Repeated Annealed Flow Transport Monte Carlo

2022-01-31 · Alexander G. D. G. Matthews, Michael Arbel, Danilo J. Rezende, Arnaud Doucet

We propose Continual Repeated Annealed Flow Transport Monte Carlo (CRAFT), a method that combines a sequential Monte Carlo (SMC) sampler (itself a generalization of Annealed Importance Sampling) with variational inferenc…

Variational Inference

An Annealed Sequential Monte Carlo Method for Bayesian Phylogenetics

2019-03-13

We describe an "embarrassingly parallel" method for Bayesian phylogenetic inference, annealed Sequential Monte Carlo, based on recent advances in the Sequential Monte Carlo literature such as adaptive determination of an…

Sandwiching the marginal likelihood using bidirectional Monte Carlo

2015-11-08 · Roger B. Grosse, Zoubin Ghahramani, Ryan P. Adams

Computing the marginal likelihood (ML) of a model requires marginalizing out all of the parameters and latent variables, a difficult high-dimensional summation or integration problem. To make matters worse, it is often h…

Clustering

Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature

2014-11-03 · NeurIPS 2014 12 · Tom Gunter, Michael A. Osborne, Roman Garnett, Philipp Hennig 외

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central chall…

Active LearningNumerical Integration