paper-with-me

홈 › Papers

Phase Transitions in Community Detection: A Solvable Toy Model

2013-12-02 · Greg Ver Steeg, Cristopher Moore, Aram Galstyan, Armen E. Allahverdyan

Recently, it was shown that there is a phase transition in the community detection problem. This transition was first computed using the cavity method, and has been proved rigorously in the case of $q=2$ groups. However, analytic calculations using the cavity method are challenging since they require us to understand probability distributions of messages. We study analogous transitions in so-called "zero-temperature inference" model, where this distribution is supported only on the most-likely messages. Furthermore, whenever several messages are equally likely, we break the tie by choosing among them with equal probability. While the resulting analysis does not give the correct values of the thresholds, it does reproduce some of the qualitative features of the system. It predicts a first-order detectability transition whenever $q > 2$, while the finite-temperature cavity method shows that this is the case only when $q > 4$. It also has a regime analogous to the "hard but detectable" phase, where the community structure can be partially recovered, but only when the initial messages are sufficiently accurate. Finally, we study a semisupervised setting where we are given the correct labels for a fraction $\rho$ of the nodes. For $q > 2$, we find a regime where the accuracy jumps discontinuously at a critical value of $\rho$.

📄 PDF Abstract BibTeX arXiv:1312.0631

Code (0)

등록된 구현이 없습니다.

Tasks

Community Detection

Similar Papers 제목 키워드 기반

Phase Transitions in Spectral Community Detection of Large Noisy Networks

2015-04-09 · Pin-Yu Chen, Alfred O. Hero III

In this paper, we study the sensitivity of the spectral clustering based community detection algorithm subject to a Erdos-Renyi type random noise model. We prove phase transitions in community detectability as a function…

ClusteringCommunity Detection

Phase Transitions of the Typical Algorithmic Complexity of the Random Satisfiability Problem Studied with Linear Programming

2017-02-09 · Hendrik Schawe, Roman Bleim, Alexander K. Hartmann

Here we study the NP-complete $K$-SAT problem. Although the worst-case complexity of NP-complete problems is conjectured to be exponential, there exist parametrized random ensembles of problems where solutions can typica…

Phase Transitions in the Output Distribution of Large Language Models

2024-05-27 · Julian Arnold, Flemming Holtorf, Frank Schäfer, Niels Lörch

In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models.…

Spherical Boltzmann machines: a solvable theory of learning and generation in energy-based models

2026-05-09 · Thomas Tulinski, Simona Cocco, Rémi Monasson, Jorge Fernandez-De-Cossio-Diaz arxiv

Energy-based models (EBMs) are flexible generative architectures inspired by statistical physics, but their learning and generative properties remain poorly understood. Here, we analyze a solvable EBM in the high-dimensi…

Grokking phase transitions in learning local rules with gradient descent

2022-10-26 · Bojan Žunkovič, Enej Ilievski

We discuss two solvable grokking (generalisation beyond overfitting) models in a rule learning scenario. We show that grokking is a phase transition and find exact analytic expressions for the critical exponents, grokkin…

Learning Theory