paper-with-me

홈 › Papers

A Sharp Universality Dichotomy for the Free Energy of Spherical Spin Glasses

2026-01-13 · Taegyun Kim arxiv

We study the free energy for pure and mixed spherical $p$-spin models with i.i.d.\ disorder. In the mixed case, each $p$-interaction layer is assumed either to have regularly varying tails with exponent $α_p$ or to satisfy a finite $2p$-th moment condition. For the pure spherical $p$-spin model with regularly varying disorder of tail index $α$, we introduce a tail-adapted normalization that interpolates between the classical Gaussian scaling and the extreme-value scale, and we prove a sharp universality dichotomy for the quenched free energy. In the subcritical regime $α<2p$, the thermodynamics is driven by finitely many extremal couplings and the free energy converges to a non-degenerate random limit described by the NIM (non-intersecting monomial) model, depending only on extreme-order statistics. At the critical exponent $α=2p$, we obtain a random one-dimensional TAP-type variational formula capturing the coexistence of an extremal spike and a universal Gaussian bulk on spherical slices. In the supercritical regime $α>2p$ (more generally, under a finite $2p$-th moment assumption), the free energy is universal and agrees with the deterministic Crisanti--Sommers/Parisi value of the corresponding Gaussian model, as established in [Sawhney-Sellke'24]. We then extend the subcritical and critical results to mixed spherical models in which each $p$-layer is either heavy-tailed with $α_p\le 2p$ or has finite $2p$-th moment. In particular, we derive a TAP-type variational representation for the mixed model, yielding a unified universality classification of the quenched free energy across tail exponents and mixtures.

📄 PDF Abstract BibTeX arXiv:2601.08599

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Phase transitions in Doi-Onsager, Noisy Transformer, and other multimodal models

2026-04-17 · Kyunghoo Mun, Matthew Rosenzweig arxiv

We study phase transitions for repulsive-attractive mean-field free energies on the circle. For a $\frac{1}{n+1}$-periodic interaction whose Fourier coefficients satisfy a certain decay condition, we prove that the criti…

Phase transitions for the noisy transformer model in arbitrary dimension

2026-06-03 · Kyunghoo Mun, Matthew Rosenzweig arxiv

We study the McKean--Vlasov free energy on the unit sphere associated with the unnormalized self-attention (USA) model for noisy transformer dynamics. We prove a sharp global-minimizer dichotomy in every dimension $d\ge2…

HoloByte: Continuous Hyperspherical Distillation for Tokenizer-Free Modeling

2026-03-10 · Vladimer Khasia arxiv

Sequence modeling universally relies on discrete subword tokenization to circumvent the $\mathcal{O}(N^2)$ computational intractability of native byte-level attention. However, this heuristic quantization imposes artific…

The Parametric Stability of Well-separated Spherical Gaussian Mixtures

2023-02-01 · Hanyu Zhang, Marina Meila

We quantify the parameter stability of a spherical Gaussian Mixture Model (sGMM) under small perturbations in distribution space. Namely, we derive the first explicit bound to show that for a mixture of spherical Gaussia…

Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation

2023-02-17 · Luca Pesce, Florent Krzakala, Bruno Loureiro, Ludovic Stephan

In this manuscript we consider the problem of generalized linear estimation on Gaussian mixture data with labels given by a single-index model. Our first result is a sharp asymptotic expression for the test and training …

All