paper-with-me

Papers

Message Passing Variational Autoregressive Network for Solving Intractable Ising Models

2024-04-09 · Qunlong Ma, Zhi Ma, Jinlong Xu, Hairui Zhang, Ming Gao

Many deep neural networks have been used to solve Ising models, including autoregressive neural networks, convolutional neural networks, recurrent neural networks, and graph neural networks. Learning a probability distribution of energy configuration or finding the ground states of a disordered, fully connected Ising model is essential for statistical mechanics and NP-hard problems. Despite tremendous efforts, a neural network architecture with the ability to high-accurately solve these fully connected and extremely intractable problems on larger systems is still lacking. Here we propose a variational autoregressive architecture with a message passing mechanism, which can effectively utilize the interactions between spin variables. The new network trained under an annealing framework outperforms existing methods in solving several prototypical Ising spin Hamiltonians, especially for larger spin systems at low temperatures. The advantages also come from the great mitigation of mode collapse during the training process of deep neural networks. Considering these extremely difficult problems to be solved, our method extends the current computational limits of unsupervised neural networks to solve combinatorial optimization problems.

📄 PDF Abstract BibTeX arXiv:2404.06225

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial Optimization

Similar Papers 제목 키워드 기반

Bayesian joint state and parameter tracking in autoregressive models

2020-06-08 · L4DC 2020 6 · Ismail Senoz, Albert Podusenko, Wouter M. Kouw, Bert de Vries

We address the problem of online Bayesian state and parameter tracking in autoregressive (AR) models with time-varying process noise variance. The involved marginalization and expectation integrals cannot be analytically…

Non-conjugate Variational Message Passing for Multinomial and Binary Regression

2011-12-01 · NeurIPS 2011 12 · David A. Knowles, Tom Minka

Variational Message Passing (VMP) is an algorithmic implementation of the Variational Bayes (VB) method which applies only in the special case of conjugate exponential family models. We propose an extension to VMP, which…

regression

Hybrid Vector Message Passing for Generalized Bilinear Factorization

2024-01-08 · Hao Jiang, Xiaojun Yuan, Qinghua Guo

In this paper, we propose a new message passing algorithm that utilizes hybrid vector message passing (HVMP) to solve the generalized bilinear factorization (GBF) problem. The proposed GBF-HVMP algorithm integrates expec…

Autoregressive Renaissance in Neural PDE Solvers

2023-10-30 · Yolanne Yi Ran Lee

Recent developments in the field of neural partial differential equation (PDE) solvers have placed a strong emphasis on neural operators. However, the paper "Message Passing Neural PDE Solver" by Brandstetter et al. publ…

Graph Neural Network

Gates

2008-12-01 · NeurIPS 2008 12 · Tom Minka, John Winn

Gates are a new notation for representing mixture models and context-sensitive independence in factor graphs. Factor graphs provide a natural representation for message-passing algorithms, such as expectation propagation…