paper-with-me

홈 › Papers

Generative Learning of Densities on Manifolds

2025-03-05 · Dimitris G. Giovanis, Ellis Crabtree, Roger G. Ghanem, Ioannis G. Kevrekidis

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent) spaces in the high-dimensional data (ambient) space. Two approaches for sampling from the latent data density are described. The first is a score-based diffusion model, which is trained to map a standard normal distribution to the latent data distribution using a neural network. The second one involves solving an It\^o stochastic differential equation in the latent space. Additional realizations of the data are generated by lifting the samples back to the ambient space using Double Diffusion Maps, a recently introduced technique typically employed in studying dynamical system reduction; here the focus lies in sampling densities rather than system dynamics. The proposed approaches enable sampling high dimensional data densities restricted to low-dimensional, a priori unknown manifolds. The efficacy of the proposed framework is demonstrated through a benchmark problem and a material with multiscale structure.

📄 PDF Abstract BibTeX arXiv:2503.03963

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Convergence of the Riemannian Langevin Algorithm

2022-04-22 · Khashayar Gatmiry, Santosh S. Vempala

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies…

Conformal Embedding Flows: Tractable Density Estimation on Learned Manifolds

2021-06-02 · ICML Workshop INNF 2021 7 · Brendan Leigh Ross, Jesse C Cresswell

Normalizing flows are generative models that provide tractable density estimation by transforming a simple distribution into a complex one. However, flows cannot directly model data supported on an unknown low-dimensiona…

Density Estimation

Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processes

2026-05-05 · Aaron Havens, Brian Karrer, Neta Shaul arxiv

Sampling from unnormalized densities is analogous to the generative modeling problem, but the target distribution is defined by a known energy function instead of data samples. Because evaluating the energy function is o…

Injective flows for star-like manifolds

2024-06-13 · Marcello Massimo Negri, Jonathan Aellen, Volker Roth

Normalizing Flows (NFs) are powerful and efficient models for density estimation. When modeling densities on manifolds, NFs can be generalized to injective flows but the Jacobian determinant becomes computationally prohi…

Density EstimationVariational Inference

Riemannian generative decoder

2025-06-23 · Andreas Bjerregaard, Søren Hauberg, Anders Krogh

Riemannian representation learning typically relies on approximating densities on chosen manifolds. This involves optimizing difficult objectives, potentially harming models. To completely circumvent this issue, we intro…

DecoderRepresentation Learning