paper-with-me

Papers

Anchored Langevin Algorithms

2025-09-23 · Mert Gurbuzbalaban, Hoang M. Nguyen, Xicheng Zhang, Lingjiong Zhu arxiv

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high dimensions and large datasets. However, they face two key limitations: (i) they require differentiable log-densities, excluding targets with non-differentiable components; and (ii) they generally fail to sample heavy-tailed targets. We propose anchored Langevin dynamics, a unified approach that accommodates non-differentiable targets and certain classes of heavy-tailed distributions. The method replaces the original potential with a smooth reference potential and modifies the Langevin diffusion via multiplicative scaling. We establish non-asymptotic guarantees in the 2-Wasserstein distance to the target distribution and provide an equivalent formulation derived via a random time change of the Langevin diffusion. We provide numerical experiments to illustrate the theory and practical performance of our proposed approach.

📄 PDF Abstract BibTeX arXiv:2509.19455

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems

2023-12-02 · Juno Kim, Kakei Yamamoto, Kazusato Oko, Zhuoran Yang 외

In this paper, we extend mean-field Langevin dynamics to minimax optimization over probability distributions for the first time with symmetric and provably convergent updates. We propose mean-field Langevin averaged grad…

LATTA: Langevin-Anchored Test-Time Adaptation for Enhanced Robustness and Stability

2025-10-07 · Harshil Vejendla arxiv

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the s…

Test-time Adaptation

Langevin algorithms for very deep Neural Networks with application to image classification

2022-12-27 · Pierre Bras

Training a very deep neural network is a challenging task, as the deeper a neural network is, the more non-linear it is. We compare the performances of various preconditioned Langevin algorithms with their non-Langevin c…

image-classificationImage Classification

Regime-Switching Langevin Monte Carlo Algorithms

2025-08-31 · Xiaoyu Wang, Yingli Wang, Lingjiong Zhu arxiv

Langevin Monte Carlo (LMC) algorithms are popular Markov Chain Monte Carlo (MCMC) methods to sample a target probability distribution, which arises in many applications in machine learning. Inspired by regime-switching s…

Non-asymptotic analysis of Langevin-type Monte Carlo algorithms

2023-03-22 · Shogo Nakakita

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main resu…

Vocal Bursts Type Prediction