paper-with-me

홈 › Papers

Bucket Renormalization for Approximate Inference

2018-03-14 · ICML 2018 7 · Sungsoo Ahn, Michael Chertkov, Adrian Weller, Jinwoo Shin

Probabilistic graphical models are a key tool in machine learning applications. Computing the partition function, i.e., normalizing constant, is a fundamental task of statistical inference but it is generally computationally intractable, leading to extensive study of approximation methods. Iterative variational methods are a popular and successful family of approaches. However, even state of the art variational methods can return poor results or fail to converge on difficult instances. In this paper, we instead consider computing the partition function via sequential summation over variables. We develop robust approximate algorithms by combining ideas from mini-bucket elimination with tensor network and renormalization group methods from statistical physics. The resulting "convergence-free" methods show good empirical performance on both synthetic and real-world benchmark models, even for difficult instances.

📄 PDF Abstract BibTeX arXiv:1803.05104

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Lifted Weighted Mini-Bucket

2018-12-01 · NeurIPS 2018 12 · Nicholas Gallo, Alexander T. Ihler

Many graphical models, such as Markov Logic Networks (MLNs) with evidence, possess highly symmetric substructures but no exact symmetries. Unfortunately, there are few principled methods that exploit these symmetric sub…

NeuroBE: NN Approximations to Bucket Elimination

2021-11-21 · AAAI Workshop CLeaR 2022 2 · Sakshi Agarwal, Kalev Kask, Alexander Ihler, Rina Dechter

A major limiting factor in graphical model inference is the complexity of computing the partition function. Exact message-passing algorithms such as Bucket Elimination (BE) require exponentially high levels of memory to …

Bayesian Renormalization

2023-05-17 · David S. Berman, Marc S. Klinger, Alexander G. Stapleton

In this note we present a fully information theoretic approach to renormalization inspired by Bayesian statistical inference, which we refer to as Bayesian Renormalization. The main insight of Bayesian Renormalization is…

Data Compression

Gauged Mini-Bucket Elimination for Approximate Inference

2018-01-05 · Sungsoo Ahn, Michael Chertkov, Jinwoo Shin, Adrian Weller

Computing the partition function $Z$ of a discrete graphical model is a fundamental inference challenge. Since this is computationally intractable, variational approximations are often used in practice. Recently, so-call…

The Inverse of Exact Renormalization Group Flows as Statistical Inference

2022-12-21 · David S. Berman, Marc S. Klinger

We build on the view of the Exact Renormalization Group (ERG) as an instantiation of Optimal Transport described by a functional convection-diffusion equation. We provide a new information theoretic perspective for under…

Bayesian Inference