paper-with-me

홈 › Papers

Belief propagation for networks with loops

2020-09-23 · Alec Kirkley, George T. Cantwell, M. E. J. Newman

Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works poorly in the common case of networks that contain short loops. Here we provide a solution to this long-standing problem, deriving a belief propagation method that allows for fast calculation of probability distributions in systems with short loops, potentially with high density, as well as giving expressions for the entropy and partition function, which are notoriously difficult quantities to compute. Using the Ising model as an example, we show that our approach gives excellent results on both real and synthetic networks, improving significantly on standard message passing methods. We also discuss potential applications of our method to a variety of other problems.

📄 PDF Abstract BibTeX arXiv:2009.12246

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Convergence of Generalized Belief Propagation Algorithm on Graphs with Motifs

2021-12-11 · Yitao Chen, Deepanshu Vasal

Belief propagation is a fundamental message-passing algorithm for numerous applications in machine learning. It is known that belief propagation algorithm is exact on tree graphs. However, belief propagation is run on lo…

$α$ Belief Propagation as Fully Factorized Approximation

2019-08-23 · Dong Liu, Nima N. Moghadam, Lars K. Rasmussen, Jinliang Huang 외

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propag…

Neural Enhanced Belief Propagation on Factor Graphs

2020-03-04 · Victor Garcia Satorras, Max Welling

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the …

Learning unbelievable probabilities

2011-12-01 · NeurIPS 2011 12 · Zachary Pitkow, Yashar Ahmadian, Ken D. Miller

Loopy belief propagation performs approximate inference on graphical models with loops. One might hope to compensate for the approximation by adjusting model parameters. Learning algorithms for this purpose have been exp…

Understanding the Behavior of Belief Propagation

2022-09-05 · Christian Knoll

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistic…