paper-with-me

홈 › Papers

Fast, Accurate Manifold Denoising by Tunneling Riemannian Optimization

2025-02-24 · Shiyu Wang, Mariam Avagyan, Yihan Shen, Arnaud Lamy, Tingran Wang, Szabolcs Márka, Zsuzsa Márka, John Wright

Learned denoisers play a fundamental role in various signal generation (e.g., diffusion models) and reconstruction (e.g., compressed sensing) architectures, whose success derives from their ability to leverage low-dimensional structure in data. Existing denoising methods, however, either rely on local approximations that require a linear scan of the entire dataset or treat denoising as generic function approximation problems, often sacrificing efficiency and interpretability. We consider the problem of efficiently denoising a new noisy data point sampled from an unknown $d$-dimensional manifold $M \in \mathbb{R}^D$, using only noisy samples. This work proposes a framework for test-time efficient manifold denoising, by framing the concept of "learning-to-denoise" as "learning-to-optimize". We have two technical innovations: (i) online learning methods which learn to optimize over the manifold of clean signals using only noisy data, effectively "growing" an optimizer one sample at a time. (ii) mixed-order methods which guarantee that the learned optimizers achieve global optimality, ensuring both efficiency and near-optimal denoising performance. We corroborate these claims with theoretical analyses of both the complexity and denoising performance of mixed-order traversal. Our experiments on scientific manifolds demonstrate significantly improved complexity-performance tradeoffs compared to nearest neighbor search, which underpins existing provable denoising approaches based on exhaustive search.

📄 PDF Abstract BibTeX arXiv:2502.16819

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensingDenoisingRiemannian optimization

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Riemannian Optimization on Relaxed Indicator Matrix Manifold

2025-03-26 · Jinghui Yuan, Fangyuan Xie, Feiping Nie, Xuelong Li

The indicator matrix plays an important role in machine learning, but optimizing it is an NP-hard problem. We propose a new relaxation of the indicator matrix and prove that this relaxation forms a manifold, which we cal…

Denoisingglobal-optimizationGraph ClusteringImage Denoising+1

Landing with the Score: Riemannian Optimization through Denoising

2025-09-27 · Andrey Kharitenko, Zebang Shen, Riccardo de Santi, Niao He 외 arxiv

Under the data manifold hypothesis, high-dimensional data are concentrated near a low-dimensional manifold. We study the problem of Riemannian optimization over such manifolds when they are given only implicitly through …

Riemannian Denoising Score Matching for Molecular Structure Optimization with Accurate Energy

2024-11-29 · Jeheon Woo, SeongHwan Kim, Jun Hyeong Kim, Woo Youn Kim

This study introduces a modified score matching method aimed at generating molecular structures with high energy accuracy. The denoising process of score matching or diffusion models mirrors molecular structure optimizat…

Computational chemistryDenoising

Fast and Robust Visuomotor Riemannian Flow Matching Policy

2024-12-14 · Haoran Ding, Noémie Jaquier, Jan Peters, Leonel Rozo

Diffusion-based visuomotor policies excel at learning complex robotic tasks by effectively combining visual data with high-dimensional, multi-modal action distributions. However, diffusion models often suffer from slow i…

Denoising

Riemannian Score-Based Generative Modelling

2022-02-06 · Valentin De Bortoli, Emile Mathieu, Michael Hutchinson, James Thornton 외

Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a ``noising'' stage, whereby a diffusion is…

Denoising