paper-with-me

홈 › Papers

Proof of the Contiguity Conjecture and Lognormal Limit for the Symmetric Perceptron

2021-02-25 · Emmanuel Abbe, Shuangping Li, Allan Sly

We consider the symmetric binary perceptron model, a simple model of neural networks that has gathered significant attention in the statistical physics, information theory and probability theory communities, with recent connections made to the performance of learning algorithms in Baldassi et al. '15. We establish that the partition function of this model, normalized by its expected value, converges to a lognormal distribution. As a consequence, this allows us to establish several conjectures for this model: (i) it proves the contiguity conjecture of Aubin et al. '19 between the planted and unplanted models in the satisfiable regime; (ii) it establishes the sharp threshold conjecture; (iii) it proves the frozen 1-RSB conjecture in the symmetric case, conjectured first by Krauth-M\'ezard '89 in the asymmetric case. In a recent work of Perkins-Xu '21, the last two conjectures were also established by proving that the partition function concentrates on an exponential scale, under an analytical assumption on a real-valued function. This left open the contiguity conjecture and the lognormal limit characterization, which are established here unconditionally, with the analytical assumption verified. In particular, our proof technique relies on a dense counter-part of the small graph conditioning method, which was developed for sparse models in the celebrated work of Robinson and Wormald.

📄 PDF Abstract BibTeX arXiv:2102.13069

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Algorithmic contiguity from low-degree conjecture and applications in correlated random graphs

2025-02-14 · Zhangsong Li

In this paper, assuming a natural strengthening of the low-degree conjecture, we provide evidence of computational hardness for two problems: (1) the (partial) matching recovery problem in the sparse correlated Erd\H{o}s…

Stochastic Block Model

Contextual Stochastic Block Model: Sharp Thresholds and Contiguity

2020-11-15 · Chen Lu, Subhabrata Sen

We study community detection in the contextual stochastic block model arXiv:1807.09596 [cs.SI], arXiv:1607.02675 [stat.ME]. In arXiv:1807.09596 [cs.SI], the second author studied this problem in the setting of sparse gra…

Community DetectionmodelStochastic Block Model

Stochastic Processes with Modified Lognormal Distribution Featuring Flexible Upper Tail

2025-05-17 · Dionissios T. Hristopulos, Anastassia Baxevani, Giorgio Kaniadakis

Asymmetric, non-Gaussian probability distributions are often observed in the analysis of natural and engineering datasets. The lognormal distribution is a standard model for data with skewed frequency histograms and fat …

Spatial InterpolationTime Series Forecasting

A combinatorial conjecture from PAC-Bayesian machine learning

2020-06-02 · M. Younsi, A. Lacasse

We present a proof of a combinatorial conjecture from the second author's Ph.D. thesis. The proof relies on binomial and multinomial sums identities. We also discuss the relevance of the conjecture in the context of PAC-…

BIG-bench Machine Learning

STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving

2025-01-31 · Kefan Dong, Tengyu Ma

A fundamental challenge in formal theorem proving by LLMs is the lack of high-quality training data. Although reinforcement learning or expert iteration partially mitigates this issue by alternating between LLM generatin…

Automated Theorem Proving