paper-with-me

Papers

Neural Enhanced Belief Propagation on Factor Graphs

2020-03-04 · Victor Garcia Satorras, Max Welling

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating process, belief propagation can infer the optimal posterior probability estimates in tree structured factor graphs. However, in many cases we may only have access to a poor approximation of the data generating process, or we may face loops in the factor graph, leading to suboptimal estimates. In this work we first extend graph neural networks to factor graphs (FG-GNN). We then propose a new hybrid model that runs conjointly a FG-GNN with belief propagation. The FG-GNN receives as input messages from belief propagation at every inference iteration and outputs a corrected version of them. As a result, we obtain a more accurate algorithm that combines the benefits of both belief propagation and graph neural networks. We apply our ideas to error correction decoding tasks, and we show that our algorithm can outperform belief propagation for LDPC codes on bursty channels.

📄 PDF Abstract BibTeX arXiv:2003.01998

Code (1)

ThyLor/Channel-Coding-Project

Similar Papers 제목 키워드 기반

$α$ Belief Propagation as Fully Factorized Approximation

2019-08-23 · Dong Liu, Nima N. Moghadam, Lars K. Rasmussen, Jinliang Huang 외

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propag…

Belief Propagation, Bethe Approximation and Polynomials

2017-08-08 · Damian Straszak, Nisheeth K. Vishnoi

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partit…

Sigma Point Belief Propagation

2013-09-02 · Florian Meyer, Ondrej Hlinka, Franz Hlawatsch

The sigma point (SP) filter, also known as unscented Kalman filter, is an attractive alternative to the extended Kalman filter and the particle filter. Here, we extend the SP filter to nonsequential Bayesian inference co…

Bayesian Inference

PGMax: Factor Graphs for Discrete Probabilistic Graphical Models and Loopy Belief Propagation in JAX

2022-02-08 · Guangyao Zhou, Antoine Dedieu, Nishanth Kumar, Wolfgang Lehrach 외

PGMax is an open-source Python package for (a) easily specifying discrete Probabilistic Graphical Models (PGMs) as factor graphs; and (b) automatically running efficient and scalable loopy belief propagation (LBP) in JAX…

Convergence of Generalized Belief Propagation Algorithm on Graphs with Motifs

2021-12-11 · Yitao Chen, Deepanshu Vasal

Belief propagation is a fundamental message-passing algorithm for numerous applications in machine learning. It is known that belief propagation algorithm is exact on tree graphs. However, belief propagation is run on lo…