paper-with-me

홈 › Papers

Evidence of Replica Symmetry Breaking under the Nishimori conditions in epidemic inference on graphs

2025-02-18 · Alfredo Braunstein, Louise Budzynski, Matteo Mariani, Federico Ricci-Tersenghi

In Bayesian inference, computing the posterior distribution from the data is typically a non-trivial problem, which usually requires approximations such as mean-field approaches or numerical methods, like the Monte Carlo Markov Chain. Being a high-dimensional distribution over a set of correlated variables, the posterior distribution can undergo the notorious replica symmetry breaking transition. When it happens, several mean-field methods and virtually every Monte Carlo scheme can not provide a reasonable approximation to the posterior and its marginals. Replica symmetry is believed to be guaranteed whenever the data is generated with known prior and likelihood distributions, namely under the so-called Nishimori conditions. In this paper, we break this belief, by providing a counter-example showing that, under the Nishimori conditions, replica symmetry breaking arises. Introducing a simple, geometrical model that can be thought of as a patient zero retrieval problem in a highly infectious regime of the epidemic Susceptible-Infectious model, we show that under the Nishimori conditions, there is evidence of replica symmetry breaking. We achieve this result by computing the instability of the replica symmetric cavity method toward the one step replica symmetry broken phase. The origin of this phenomenon -- replica symmetry breaking under the Nishimori conditions -- is likely due to the correlated disorder appearing in the epidemic models.

📄 PDF Abstract BibTeX arXiv:2502.13249

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Statistical physics of unsupervised learning with prior knowledge in neural networks

2019-11-06 · Tianqi Hou, Haiping Huang

Integrating sensory inputs with prior beliefs from past experiences in unsupervised learning is a common and fundamental characteristic of brain or artificial neural computation. However, a quantitative role of prior kno…

The planted XY model: thermodynamics and inference

2022-08-12 · Siyu Chen, Guanhao Huang, Giovanni Piccioli, Lenka Zdeborová

In this paper we study a fully connected planted spin glass named the planted XY model. Motivation for studying this system comes both from the spin glass field and the one of statistical inference where it models the an…

model

Fundamental operating regimes, hyper-parameter fine-tuning and glassiness: towards an interpretable replica-theory for trained restricted Boltzmann machines

2024-06-14 · Alberto Fachechi, Elena Agliari, Miriam Aquaro, Anthony Coolen 외

We consider restricted Boltzmann machines with a binary visible layer and a Gaussian hidden layer trained by an unlabelled dataset composed of noisy realizations of a single ground pattern. We develop a statistical mecha…

Approximate Survey Propagation for Statistical Inference

2018-07-03 · Fabrizio Antenucci, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová

Approximate message passing algorithm enjoyed considerable attention in the last decade. In this paper we introduce a variant of the AMP algorithm that takes into account glassy nature of the system under consideration. …

Survey

Replica Symmetry Breaking in Bipartite Spin Glasses and Neural Networks

2018-03-17 · Gavin Hartnett, Edward Parker, Edward Geist

Some interesting recent advances in the theoretical understanding of neural networks have been informed by results from the physics of disordered many-body systems. Motivated by these findings, this work uses the replica…

graph partitioning