paper-with-me

홈 › Papers

Non-stationary Douglas-Rachford and alternating direction method of multipliers: adaptive stepsizes and convergence

2018-01-11 · Dirk A. Lorenz, Quoc Tran-Dinh

We revisit the classical Douglas-Rachford (DR) method for finding a zero of the sum of two maximal monotone operators. Since the practical performance of the DR method crucially depends on the stepsizes, we aim at developing an adaptive stepsize rule. To that end, we take a closer look at a linear case of the problem and use our findings to develop a stepsize strategy that eliminates the need for stepsize tuning. We analyze a general non-stationary DR scheme and prove its convergence for a convergent sequence of stepsizes with summable increments. This, in turn, proves the convergence of the method with the new adaptive stepsize rule. We also derive the related non-stationary alternating direction method of multipliers (ADMM) from such a non-stationary DR method. We illustrate the efficiency of the proposed methods on several numerical examples.

📄 PDF Abstract BibTeX arXiv:1801.03765

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bregman Douglas-Rachford Splitting Method

2025-09-10 · Shiqian Ma, Lin Xiao, Renbo Zhao arxiv

In this paper, we propose the Bregman Douglas-Rachford splitting (BDRS) method and its variant Bregman Peaceman-Rachford splitting method for solving maximal monotone inclusion problem. We show that BDRS is equivalent to…

Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identification

2024-10-12 · Kexin Li, Luwei Bai, Xiao Wang, Hao Wang

Anderson acceleration is an effective technique for enhancing the efficiency of fixed-point iterations; however, analyzing its convergence in nonsmooth settings presents significant challenges. In this paper, we investig…

Tensor completion and low-n-rank tensor recovery via convex optimization

2011-02-24 · IOPScience 2011 2 · Silvia Gandy, Benjamin Recht and Isao Yamada

In this paper we consider sparsity on a tensor level, as given by the n-rank of a tensor. In the important sparse-vector approximation problem (compressed sensing) and the low-rank matrix recovery problem, using a conv…

compressed sensing

Halpern-Type Accelerated and Splitting Algorithms For Monotone Inclusions

2021-10-15 · Quoc Tran-Dinh, Yang Luo

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on …

Vocal Bursts Type Prediction

Douglas-Rachford splitting for nonconvex optimization with application to nonconvex feasibility problems

2014-09-30 · Guoyin Li, Ting Kei Pong

We adapt the Douglas-Rachford (DR) splitting method to solve nonconvex feasibility problems by studying this method for a class of nonconvex optimization problem. While the convergence properties of the method for convex…