paper-with-me

Papers

A Theory of Speciation in Generative Diffusion Models on Compact Riemannian Manifolds

2026-08-24 · Alessio Marta, Paola Causin arxiv

Speciation in generative diffusion models denotes the emergence of distinct stable branches during denoising, through which initially undifferentiated trajectories progressively commit to different data classes. In this work we develop an intrinsic theory of speciation for diffusion models supported on compact Riemannian manifolds: the aim is to go beyond existing theoretical descriptions, which usually identify speciation with a symmetric pitchfork bifurcation and assume to work in a large-dimensional space. We characterize speciation by bifurcations of the critical points of the evolving probability density. A spectral heat-kernel representation makes explicit the role of the manifold geometry, while Poincaré-Hopf and Morse theory impose global constraints on the number and type of score equilibria and reveal topologically-imposed geometrical modes. For mixtures of heat kernels, we prove that generic speciation events have a one-dimensional critical kernel and admit an A2 fold normal form; pitchforks and simultaneous multidirectional transitions arise from nongeneric symmetric configurations. We derive geometry-dependent estimates of speciation times for bimodal mixtures and Riemannian regular simplices. We further establish structural stability of nondegenerate folds under score perturbations and show that the first-order time shift is determined solely by the component of the score error along the critical direction. The theory is illustrated on the sphere using mixtures of von Mises-Fisher distributions, where pitchfork and saddle-node bifurcations, topological modes, and hierarchical multiple speciations are observed. Finally, a chart-based intrinsic score-learning scheme based on neural networks contrasts the theoretically predicted transitions on prototypal and more complex datasets.

📄 PDF Abstract BibTeX arXiv:2608.23798

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Theory of Speciation Transitions in Diffusion Models with General Class Structure

2026-02-04 · Beatrice Achilli, Marco Benedetti, Giulio Biroli, Marc Mézard arxiv

Diffusion Models generate data by reversing a stochastic diffusion process, progressively transforming noise into structured samples drawn from a target distribution. Recent theoretical work has shown that this backward …

Score Shocks: The Burgers Equation Structure of Diffusion Generative Models

2026-04-08 · Krisanu Sarkar arxiv

We analyze the score field of a diffusion generative model through a Burgers-type evolution law. For VE diffusion, the heat-evolved data density implies that the score obeys viscous Burgers in one dimension and the corre…

Dynamical Regimes of Diffusion Models

2024-02-28 · Giulio Biroli, Tony Bonnaire, Valentin De Bortoli, Marc Mézard

Using statistical physics methods, we study generative diffusion models in the regime where the dimension of space and the number of data are large, and the score function has been trained optimally. Our analysis reveals…

Steering Dynamical Regimes of Diffusion Models by Breaking Detailed Balance

2026-02-17 · Haiqi Lu, Ying Tang arxiv

We show that deliberately breaking detailed balance in generative diffusion processes can accelerate the reverse process without changing the stationary distribution. Considering the Ornstein--Uhlenbeck process, we decom…

Riemannian Diffusion Schrödinger Bridge

2022-07-07 · James Thornton, Michael Hutchinson, Emile Mathieu, Valentin De Bortoli 외

Score-based generative models exhibit state of the art performance on density estimation and generative modeling tasks. These models typically assume that the data geometry is flat, yet recent extensions have been develo…

Density Estimation