paper-with-me

홈 › Papers

Manifold Learning with Normalizing Flows: Towards Regularity, Expressivity and Iso-Riemannian Geometry

2025-05-12 · Willem Diepeveen, Deanna Needell

Modern machine learning increasingly leverages the insight that high-dimensional data often lie near low-dimensional, non-linear manifolds, an idea known as the manifold hypothesis. By explicitly modeling the geometric structure of data through learning Riemannian geometry algorithms can achieve improved performance and interpretability in tasks like clustering, dimensionality reduction, and interpolation. In particular, learned pullback geometry has recently undergone transformative developments that now make it scalable to learn and scalable to evaluate, which further opens the door for principled non-linear data analysis and interpretable machine learning. However, there are still steps to be taken when considering real-world multi-modal data. This work focuses on addressing distortions and modeling errors that can arise in the multi-modal setting and proposes to alleviate both challenges through isometrizing the learned Riemannian structure and balancing regularity and expressivity of the diffeomorphism parametrization. We showcase the effectiveness of the synergy of the proposed approaches in several numerical experiments with both synthetic and real data.

📄 PDF Abstract BibTeX arXiv:2505.08087

Code (1)

wdiepeveen/iso-Riemannian-geometry 공식 구현 pytorch

Tasks

Dimensionality ReductionInterpretable Machine Learning

Similar Papers 제목 키워드 기반

Riemannian Continuous Normalizing Flows

2020-06-18 · NeurIPS 2020 12 · Emile Mathieu, Maximilian Nickel

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, t…

Normalizing Flows on Riemannian Manifolds

2016-11-07 · Mevlana C. Gemici, Danilo Rezende, Shakir Mohamed

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular va…

Density EstimationProtein Folding

Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspective

2026-05-07 · Meira Iske, Carola-Bibiane Schönlieb arxiv

Many normalizing flow architectures impose regularity constraints, yet their distributional approximation properties are not fully characterized. We study the expressivity of bi-Lipschitz normalizing flows through the le…

VQ-Flows: Vector Quantized Local Normalizing Flows

2022-03-22 · Sahil Sidheekh, Chris B. Dock, Tushar Jain, Radu Balan 외

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations…

Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows

2024-10-02 · Willem Diepeveen, Georgios Batzolis, Zakhar Shumaylov, Carola-Bibiane Schönlieb

Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings…

Representation Learning