paper-with-me

홈 › Papers

Structured Message Passing

2013-09-26 · Vibhav Gogate, Pedro Domingos

In this paper, we present structured message passing (SMP), a unifying framework for approximate inference algorithms that take advantage of structured representations such as algebraic decision diagrams and sparse hash tables. These representations can yield significant time and space savings over the conventional tabular representation when the message has several identical values (context-specific independence) or zeros (determinism) or both in its range. Therefore, in order to fully exploit the power of structured representations, we propose to artificially introduce context-specific independence and determinism in the messages. This yields a new class of powerful approximate inference algorithms which includes popular algorithms such as cluster-graph Belief propagation (BP), expectation propagation and particle BP as special cases. We show that our new algorithms introduce several interesting bias-variance trade-offs. We evaluate these trade-offs empirically and demonstrate that our new algorithms are more accurate and scalable than state-of-the-art techniques.

📄 PDF Abstract BibTeX arXiv:1309.6832

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Variational Message Passing with Structured Inference Networks

2018-03-15 · ICLR 2018 1 · Wu Lin, Nicolas Hubacher, Mohammad Emtiyaz Khan

Recent efforts on combining deep models with probabilistic graphical models are promising in providing flexible models that are also easy to interpret. We propose a variational message-passing algorithm for variational i…

Variational Inference

Learning Symbolic Models for Graph-structured Physical Mechanism

2023-02-02 · ICLR 2023 2023 2 · Hongzhi Shi, Jingtao Ding, Yufan Cao, Quanming Yao 외

Graph-structured physical mechanisms are ubiquitous in real-world scenarios, thus revealing underneath formulas is of great importance for scientific discovery. However, classical symbolic regression methods fail on this…

regressionscientific discoverySymbolic Regression

FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks

2022-10-17 · Syed Asad Rizvi, Nazreen Pallikkavaliyaveetil, David Zhang, Zhuoyang Lyu 외

Foundation models have achieved remarkable success across many domains, relying on pretraining over vast amounts of data. Graph-structured data often lacks the same scale as unstructured data, making the development of g…

BenchmarkingGraph Neural NetworkRepresentation Learning

Deeply Learning the Messages in Message Passing Inference

2015-06-06 · NeurIPS 2015 12 · Guosheng Lin, Chunhua Shen, Ian Reid, Anton Van Den Hengel

Deep structured output learning shows great promise in tasks like semantic image segmentation. We proffer a new, efficient deep structured model learning scheme, in which we show how deep Convolutional Neural Networks (C…

Image SegmentationSemantic SegmentationStructured Prediction

Policy Message Passing: A New Algorithm for Probabilistic Graph Inference

2019-09-29 · ICLR 2020 1 · Zhiwei Deng, Greg Mori

A general graph-structured neural network architecture operates on graphs through two core components: (1) complex enough message functions; (2) a fixed information aggregation process. In this paper, we present the Poli…