paper-with-me

Papers

Complexity of zigzag sampling algorithm for strongly log-concave distributions

2020-12-21 · Jianfeng Lu, Lihan Wang

We study the computational complexity of zigzag sampling algorithm for strongly log-concave distributions. The zigzag process has the advantage of not requiring time discretization for implementation, and that each proposed bouncing event requires only one evaluation of partial derivative of the potential, while its convergence rate is dimension independent. Using these properties, we prove that the zigzag sampling algorithm achieves $\varepsilon$ error in chi-square divergence with a computational cost equivalent to $O\bigl(\kappa^2 d^\frac{1}{2}(\log\frac{1}{\varepsilon})^{\frac{3}{2}}\bigr)$ gradient evaluations in the regime $\kappa \ll \frac{d}{\log d}$ under a warm start assumption, where $\kappa$ is the condition number and $d$ is the dimension.

📄 PDF Abstract BibTeX arXiv:2012.11094

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The query complexity of sampling from strongly log-concave distributions in one dimension

2021-05-29 · Sinho Chewi, Patrik Gerber, Chen Lu, Thibaut Le Gouic 외

We establish the first tight lower bound of $\Omega(\log\log\kappa)$ on the query complexity of sampling from the class of strongly log-concave and log-smooth distributions with condition number $\kappa$ in one dimension…

A unified complexity bound for logconcave sampling

2026-06-10 · Yunbum Kook, Santosh S. Vempala arxiv

We give a simple, unified, and nearly tight bound for sampling arbitrary logconcave distributions from a warm start using the In-and-Out algorithm along with exponential lifting. The main new ingredient in the analysis i…

A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems

2020-06-03 · Zi Xu, Huiling Zhang, Yang Xu, Guanghui Lan

Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent appli…

Improved dimension dependence of a proximal algorithm for sampling

2023-02-20 · Jiaojiao Fan, Bo Yuan, Yongxin Chen

We propose a sampling algorithm that achieves superior complexity bounds in all the classical settings (strongly log-concave, log-concave, Logarithmic-Sobolev inequality (LSI), Poincar\'e inequality) as well as more gene…

Bounding the error of discretized Langevin algorithms for non-strongly log-concave targets

2019-06-20 · Arnak S. Dalalyan, Avetik Karagulyan, Lionel Riou-Durand

In this paper, we provide non-asymptotic upper bounds on the error of sampling from a target density using three schemes of discretized Langevin diffusions. The first scheme is the Langevin Monte Carlo (LMC) algorithm, t…