paper-with-me

Papers

Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows

2024-10-02 · Willem Diepeveen, Georgios Batzolis, Zakhar Shumaylov, Carola-Bibiane Schönlieb

Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings with efficient training algorithms. In this work, we integrate concepts from pullback Riemannian geometry and generative models to propose a framework for data-driven Riemannian geometry that is scalable in both geometry and learning: score-based pullback Riemannian geometry. Focusing on unimodal distributions as a first step, we propose a score-based Riemannian structure with closed-form geodesics that pass through the data probability density. With this structure, we construct a Riemannian autoencoder (RAE) with error bounds for discovering the correct data manifold dimension. This framework can naturally be used with anisotropic normalizing flows by adopting isometry regularization during training. Through numerical experiments on diverse datasets, including image data, we demonstrate that the proposed framework produces high-quality geodesics passing through the data support, reliably estimates the intrinsic dimension of the data manifold, and provides a global chart of the manifold. To the best of our knowledge, this is the first scalable framework for extracting the complete geometry of the data manifold.

📄 PDF Abstract BibTeX arXiv:2410.01950

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Pulling back symmetric Riemannian geometry for data analysis

2024-03-11 · Willem Diepeveen

Data sets tend to live in low-dimensional non-linear subspaces. Ideal data analysis tools for such data sets should therefore account for such non-linear geometry. The symmetric Riemannian geometry setting can be suitabl…

A singular Riemannian geometry approach to Deep Neural Networks I. Theoretical foundations

2021-12-17 · Alessandro Benfenati, Alessio Marta

Deep Neural Networks are widely used for solving complex problems in several scientific areas, such as speech recognition, machine translation, image analysis. The strategies employed to investigate their theoretical pro…

Machine Translationspeech-recognitionSpeech Recognition

Riemannian Geometry for Pre-trained Language Model Embeddings

2026-07-08 · Szczepan Konior, Alexandre Quemy, Przemysław Klocek, Grégoire Cattan 외 arxiv

Understanding the geometric structure of pre-trained language model embeddings matters for interpretability and safety. We ask whether sentence-level classification signal lives in the Riemannian geometry of contextual t…

Identifying latent distances with Finslerian geometry

2022-12-20 · Alison Pouplin, David Eklund, Carl Henrik Ek, Søren Hauberg

Riemannian geometry provides us with powerful tools to explore the latent space of generative models while preserving the underlying structure of the data. The latent space can be equipped it with a Riemannian metric, pu…

Navigate

Riemannian Archetypal Analysis: Interpretable non-linear data analysis on deformed star distributions

2026-05-22 · Willem Diepeveen, Deanna Needell arxiv

Classical archetypal analysis is appealing for its interpretability, but its linear geometry can limit performance on data with strongly non-linear structure; at the same time, existing neural extensions improve flexibil…