paper-with-me

홈 › Papers

Stochastic Proximal Langevin Algorithm: Potential Splitting and Nonasymptotic Rates

2019-05-28 · NeurIPS 2019 12 · Adil Salim, Dmitry Kovalev, Peter Richtárik

We propose a new algorithm---Stochastic Proximal Langevin Algorithm (SPLA)---for sampling from a log concave distribution. Our method is a generalization of the Langevin algorithm to potentials expressed as the sum of one stochastic smooth term and multiple stochastic nonsmooth terms. In each iteration, our splitting technique only requires access to a stochastic gradient of the smooth term and a stochastic proximal operator for each of the nonsmooth terms. We establish nonasymptotic sublinear and linear convergence rates under convexity and strong convexity of the smooth term, respectively, expressed in terms of the KL divergence and Wasserstein distance. We illustrate the efficiency of our sampling technique through numerical simulations on a Bayesian learning task.

📄 PDF Abstract BibTeX arXiv:1905.11768

Code (1)

adil-salim/SPLA 공식 구현

Similar Papers 제목 키워드 기반

From stability of Langevin diffusion to convergence of proximal MCMC for non-log-concave sampling

2025-05-20 · Marien Renaud, Valentin De Bortoli, Arthur Leclaire, Nicolas Papadakis

We consider the problem of sampling distributions stemming from non-convex potentials with Unadjusted Langevin Algorithm (ULA). We prove the stability of the discrete-time ULA to drift approximations under the assumption…

Primal Dual Interpretation of the Proximal Stochastic Gradient Langevin Algorithm

2020-06-16 · NeurIPS 2020 12 · Adil Salim, Peter Richtárik

We consider the task of sampling with respect to a log concave probability distribution. The potential of the target distribution is assumed to be composite, \textit{i.e.}, written as the sum of a smooth convex term, and…

Gradient flows and proximal splitting methods: A unified view on accelerated and stochastic optimization

2019-08-02 · Guilherme França, Daniel P. Robinson, René Vidal

Optimization is at the heart of machine learning, statistics and many applied scientific disciplines. It also has a long history in physics, ranging from the minimal action principle to finding ground states of disordere…

BIG-bench Machine LearningDistributed OptimizationStochastic Optimization

Faster Sampling via Stochastic Gradient Proximal Sampler

2024-05-27 · Xunpeng Huang, Difan Zou, Yi-An Ma, Hanze Dong 외

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster…

Stochastic proximal splitting algorithm for composite minimization

2019-12-04 · Andrei Patrascu, Paul Irofti

Supported by the recent contributions in multiple branches, the first-order splitting algorithms became central for structured nonsmooth optimization. In the large-scale or noisy contexts, when only stochastic informatio…