paper-with-me

Papers

Projective Splitting with Forward Steps: Asynchronous and Block-Iterative Operator Splitting

2018-03-19 · Patrick R. Johnstone, Jonathan Eckstein

This work is concerned with the classical problem of finding a zero of a sum of maximal monotone operators. For the projective splitting framework recently proposed by Combettes and Eckstein, we show how to replace the fundamental subproblem calculation using a backward step with one based on two forward steps. The resulting algorithms have the same kind of coordination procedure and can be implemented in the same block-iterative and highly flexible manner, but may perform backward steps on some operators and forward steps on others. Prior algorithms in the projective splitting family have used only backward steps. Forward steps can be used for any Lipschitz-continuous operators provided the stepsize is bounded by the inverse of the Lipschitz constant. If the Lipschitz constant is unknown, a simple backtracking linesearch procedure may be used. For affine operators, the stepsize can be chosen adaptively without knowledge of the Lipschitz constant and without any additional forward steps. We close the paper by empirically studying the performance of several kinds of splitting algorithms on a large-scale rare feature selection problem.

📄 PDF Abstract BibTeX arXiv:1803.07043

Code (1)

1austrartsua1/proj_split_pub

Tasks

feature selection

Similar Papers 제목 키워드 기반

Single-Forward-Step Projective Splitting: Exploiting Cocoercivity

2019-02-24 · Patrick R. Johnstone, Jonathan Eckstein

This work describes a new variant of projective splitting for solving maximal monotone inclusions and complicated convex optimization problems. In the new version, cocoercive operators can be processed with a single forw…

Projective Splitting with Forward Steps only Requires Continuity

2018-09-17 · Patrick R. Johnstone, Jonathan Eckstein

A recent innovation in projective splitting algorithms for monotone operator inclusions has been the development of a procedure using two forward steps instead of the customary proximal steps for operators that are Lipsc…

Efficient Parsing for Head-Split Dependency Trees

2013-01-01 · TACL 2013 1 · Giorgio Satta, Marco Kuhlmann

Head splitting techniques have been successfully exploited to improve the asymptotic runtime of parsing algorithms for projective dependency trees, under the arc-factored model. In this article we extend these techniques…

ARCDependency Parsing

Convergence Rates for Projective Splitting

2018-06-11 · Patrick R. Johnstone, Jonathan Eckstein

Projective splitting is a family of methods for solving inclusions involving sums of maximal monotone operators. First introduced by Eckstein and Svaiter in 2008, these methods have enjoyed significant innovation in rece…

An Asynchronous Decentralised Optimisation Algorithm for Nonconvex Problems

2025-07-30 · Behnam Mafakheri, Jonathan H. Manton, Iman Shames arxiv

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method w…