paper-with-me

홈 › Papers

CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solver

2024-03-05 · Zhenyu Pan, Ammar Gilani, En-Jui Kuo, Zhuo Liu

We propose an RNN-based efficient Ising model solver, the Criticality-ordered Recurrent Mean Field (CoRMF), for forward Ising problems. In its core, a criticality-ordered spin sequence of an $N$-spin Ising model is introduced by sorting mission-critical edges with greedy algorithm, such that an autoregressive mean-field factorization can be utilized and optimized with Recurrent Neural Networks (RNNs). Our method has two notable characteristics: (i) by leveraging the approximated tree structure of the underlying Ising graph, the newly-obtained criticality order enables the unification between variational mean-field and RNN, allowing the generally intractable Ising model to be efficiently probed with probabilistic inference; (ii) it is well-modulized, model-independent while at the same time expressive enough, and hence fully applicable to any forward Ising inference problems with minimal effort. Computationally, by using a variance-reduced Monte Carlo gradient estimator, CoRFM solves the Ising problems in a self-train fashion without data/evidence, and the inference tasks can be executed by directly sampling from RNN. Theoretically, we establish a provably tighter error bound than naive mean-field by using the matrix cut decomposition machineries. Numerically, we demonstrate the utility of this framework on a series of Ising datasets.

📄 PDF Abstract BibTeX arXiv:2403.03391

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A General Description of Criticality in Neural Network Models

2023-08-25 · Longbin Zeng, Fengjian Feng, Wenlian Lu

Recent experimental observations have supported the hypothesis that the cerebral cortex operates in a dynamical regime near criticality, where the neuronal network exhibits a mixture of ordered and disordered patterns. H…

Hall-Like Transversal Stress and Sandpile Criticality on Real Production Networks

2026-05-02 · Diego Vallarino arxiv

This paper develops a Hall-Sandpile model of economic instability that combines a Hall-like transversal stress mechanism with sandpile threshold dynamics on a real production-network substrate. In analogy with the physic…

Cooperation, competition and the emergence of criticality in communities of adaptive systems

2016-03-22

The hypothesis that living systems can benefit from operating at the vicinity of critical points has gained momentum in recent years. Criticality may confer an optimal balance between exceedingly ordered and too noisy st…

Deep Information Propagation

2016-11-04 · Samuel S. Schoenholz, Justin Gilmer, Surya Ganguli, Jascha Sohl-Dickstein

We study the behavior of untrained neural networks whose weights and biases are randomly distributed using mean field theory. We show the existence of depth scales that naturally limit the maximum depth of signal propaga…

The edge of chaos: quantum field theory and deep neural networks

2021-09-27 · Kevin T. Grosvenor, Ro Jefferson

We explicitly construct the quantum field theory corresponding to a general class of deep neural networks encompassing both recurrent and feedforward architectures. We first consider the mean-field theory (MFT) obtained …