paper-with-me

Papers

DC-DistADMM: ADMM Algorithm for Constrained Distributed Optimization over Directed Graphs

2020-03-30 · Vivek Khatana, Murti V. Salapaka

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees. \textcolor{black}{The algorithm accrues all the benefits of the Alternating Direction Method of Multipliers (ADMM) approach}. It also overcomes the limitations of existing methods on convex optimization problems with linear inequality, equality and set constraints by allowing directed communication topologies. Moreover, the algorithm can be synthesized distributively. The developed algorithm has: (i) a $O(1/k)$ rate of convergence, where $k$ is the iteration counter, when individual functions are convex but not-necessarily differentiable, and (ii) a geometric rate of convergence to any arbitrary small neighborhood of the optimal solution, when the objective functions are smooth and restricted strongly convex at the optimal solution. The efficacy of the algorithm is evaluated by a comparison with state-of-the-art constrained optimization algorithms in solving a constrained distributed $\ell_1$-regularized logistic regression problem, and unconstrained optimization algorithms in solving a $\ell_1$-regularized Huber loss minimization problem. Additionally, a comparison of the algorithm's performance with other algorithms in the literature that utilize multiple communication steps is provided.

📄 PDF Abstract BibTeX arXiv:2003.13742

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed Optimization

Methods 이 논문이 사용한 방법론

Huber loss The Huber loss function describes the penalty incurred by an estimation procedure f. Huber (1964) defines the loss function piecewise by[1] L δ ( a ) = { 1 2 a 2 for | a |…

Similar Papers 제목 키워드 기반

Distributed Convex Optimization with Many Convex Constraints

2016-10-07 · Joachim Giesen, Sören Laue

We address the problem of solving convex optimization problems with many convex constraints in a distributed setting. Our approach is based on an extension of the alternating direction method of multipliers (ADMM) that r…

Widely Distributed Radar Imaging: Unmediated ADMM Based Approach

2022-03-10 · Ahmed Murtada, Ruizhi Hu, Bhavani Shankar Mysore Rama Rao, Udo Schroeder

In this paper, we present a novel approach to reconstruct a unique image of an observed scene with widely distributed radar sensors. The problem is posed as a constrained optimization problem in which the global image wh…

Distributed Linear Regression with Compositional Covariates

2023-10-21 · Yue Chao, Lei Huang, Xuejun Ma

With the availability of extraordinarily huge data sets, solving the problems of distributed statistical methodology and computing for such data sets has become increasingly crucial in the big data area. In this paper, w…

Distributed Optimizationregression

Limited Communications Distributed Optimization via Deep Unfolded Distributed ADMM

2023-09-21 · Yoav Noah, Nir Shlezinger

Distributed optimization is a fundamental framework for collaborative inference and decision making in decentralized multi-agent systems. The operation is modeled as the joint minimization of a shared objective which typ…

Collaborative InferenceDecision MakingDistributed Optimization

A Distributed Algorithm for Measure-valued Optimization with Additive Objective

2022-02-17 · Iman Nodozi, Abhishek Halder

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sa…