paper-with-me

홈 › Papers

Generalization of graph network inferences in higher-order graphical models

2021-07-12 · Yicheng Fei, Xaq Pitkow

Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major challenge for these graphical models is that inferences such as marginalization are intractable for general graphs. These inferences are often approximated by a distributed message-passing algorithm such as Belief Propagation, which does not always perform well on graphs with cycles, nor can it always be easily specified for complex continuous probability distributions. Such difficulties arise frequently in expressive graphical models that include intractable higher-order interactions. In this paper we define the Recurrent Factor Graph Neural Network (RF-GNN) to achieve fast approximate inference on graphical models that involve many-variable interactions. Experimental results on several families of graphical models demonstrate the out-of-distribution generalization capability of our method to different sized graphs, and indicate the domain in which our method outperforms Belief Propagation (BP). Moreover, we test the RF-GNN on a real-world Low-Density Parity-Check dataset as a benchmark along with other baseline models including BP variants and other GNN methods. Overall we find that RF-GNNs outperform other methods under high noise levels.

📄 PDF Abstract BibTeX arXiv:2107.05729

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkOut-of-Distribution Generalization

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Higher-Order Minimum Cost Lifted Multicuts for Motion Segmentation

2017-04-06 · ICCV 2017 10 · Margret Keuper

Most state-of-the-art motion segmentation algorithms draw their potential from modeling motion differences of local entities such as point trajectories in terms of pairwise potentials in graphical models. Inference in in…

Motion SegmentationSegmentation

A new look at reweighted message passing

2013-09-22 · Vladimir Kolmogorov

We propose a new family of message passing techniques for MAP estimation in graphical models which we call {\em Sequential Reweighted Message Passing} (SRMP). Special cases include well-known techniques such as {\em Min-…

Interference Effects in Quantum Belief Networks

2014-09-30 · Catarina Moreira, Andreas Wichert

Probabilistic graphical models such as Bayesian Networks are one of the most powerful structures known by the Computer Science community for deriving probabilistic inferences. However, modern cognitive psychology has rev…

Decision Making

Imagined versus Remembered Stories: Quantifying Differences in Narrative Flow

2022-01-07 · Maarten Sap, Anna Jafarpour, Yejin Choi, Noah A. Smith 외

Lifelong experiences and learned knowledge lead to shared expectations about how common situations tend to unfold. Such knowledge of narrative event flow enables people to weave together a story. However, comparable comp…

Language ModellingLarge Language ModelSentenceText Generation

Learning Higher-Order Graph Structure with Features by Structure Penalty

2011-12-01 · NeurIPS 2011 12 · Shilin Ding, Grace Wahba, Jerry Zhu

In discrete undirected graphical models, the conditional independence of node labels Y is specified by the graph structure. We study the case where there is another input random vector X (e.g. observed features) such tha…