paper-with-me

Papers

An Accelerated Stochastic Algorithm for Solving the Optimal Transport Problem

2022-03-02 · Yiling Xie, Yiling Luo, Xiaoming Huo

A primal-dual accelerated stochastic gradient descent with variance reduction algorithm (PDASGD) is proposed to solve linear-constrained optimization problems. PDASGD could be applied to solve the discrete optimal transport (OT) problem and enjoys the best-known computational complexity -- $\widetilde{\mathcal{O}}(n^2/\epsilon)$, where $n$ is the number of atoms, and $\epsilon>0$ is the accuracy. In the literature, some primal-dual accelerated first-order algorithms, e.g., APDAGD, have been proposed and have the order of $\widetilde{\mathcal{O}}(n^{2.5}/\epsilon)$ for solving the OT problem. To understand why our proposed algorithm could improve the rate by a factor of $\widetilde{\mathcal{O}}(\sqrt{n})$, the conditions under which our stochastic algorithm has a lower order of computational complexity for solving linear-constrained optimization problems are discussed. It is demonstrated that the OT problem could satisfy the aforementioned conditions. Numerical experiments demonstrate superior practical performances of the proposed PDASGD algorithm for solving the OT problem.

📄 PDF Abstract BibTeX arXiv:2203.00813

Code (1)

yilingxie27/pdasgd 공식 구현

Similar Papers 제목 키워드 기반

Improved Rate of First Order Algorithms for Entropic Optimal Transport

2023-01-23 · Yiling Luo, Yiling Xie, Xiaoming Huo

This paper improves the state-of-the-art rate of a first-order algorithm for solving entropy regularized optimal transport. The resulting rate for approximating the optimal transport (OT) has been improved from $\widetil…

Greedy stochastic algorithms for entropy-regularized optimal transport problems

2018-03-04 · Brahim Khalil Abid, Robert M. Gower

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we …

A unified variance-reduced accelerated gradient method for convex optimization

2019-05-29 · NeurIPS 2019 12 · Guanghui Lan, Zhize Li, Yi Zhou

We propose a novel randomized incremental gradient algorithm, namely, VAriance-Reduced Accelerated Gradient (Varag), for finite-sum optimization. Equipped with a unified step-size policy that adjusts itself to the value …

Fast Algorithms for Computational Optimal Transport and Wasserstein Barycenter

2019-05-23 · Wenshuo Guo, Nhat Ho, Michael. I. Jordan

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over stat…

Designing Algorithms for Entropic Optimal Transport from an Optimisation Perspective

2025-07-16 · Vishwak Srinivasan, Qijia Jiang arxiv

In this work, we develop a collection of novel methods for the entropic-regularised optimal transport problem, which are inspired by existing mirror descent interpretations of the Sinkhorn algorithm used for solving this…