paper-with-me

Papers

Distributed Inexact Successive Convex Approximation ADMM: Analysis-Part I

2019-07-21 · Sandeep Kumar, Ketan Rajawat, Daniel P. Palomar

In this two-part work, we propose an algorithmic framework for solving non-convex problems whose objective function is the sum of a number of smooth component functions plus a convex (possibly non-smooth) or/and smooth (possibly non-convex) regularization function. The proposed algorithm incorporates ideas from several existing approaches such as alternate direction method of multipliers (ADMM), successive convex approximation (SCA), distributed and asynchronous algorithms, and inexact gradient methods. Different from a number of existing approaches, however, the proposed framework is flexible enough to incorporate a class of non-convex objective functions, allow distributed operation with and without a fusion center, and include variance reduced methods as special cases. Remarkably, the proposed algorithms are robust to uncertainties arising from random, deterministic, and adversarial sources. The part I of the paper develops two variants of the algorithm under very mild assumptions and establishes first-order convergence rate guarantees. The proof developed here allows for generic errors and delays, paving the way for different variance-reduced, asynchronous, and stochastic implementations, outlined and evaluated in part II.

📄 PDF Abstract BibTeX arXiv:1907.08969

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning

2024-02-21 · Yongcun Song, Ziqi Wang, Enrique Zuazua

Federated learning (FL) is a promising framework for learning from distributed data while maintaining privacy. The development of efficient FL algorithms encounters various challenges, including heterogeneous data and sy…

Federated Learning

Learning (With) Distributed Optimization

2023-08-10 · Aadharsh Aadhithya A, Abinesh S, Akshaya J, Jayanth M 외

This paper provides an overview of the historical progression of distributed optimization techniques, tracing their development from early duality-based methods pioneered by Dantzig, Wolfe, and Benders in the 1960s to th…

Distributed Optimization

Robust Online Learning over Networks

2023-09-01 · Nicola Bastianello, Diego Deplano, Mauro Franceschelli, Karl H. Johansson

The recent deployment of multi-agent networks has enabled the distributed solution of learning problems, where agents cooperate to train a global model without sharing their local, private data. This work specifically ta…

Distributed Stochastic Nonconvex Optimization and Learning based on Successive Convex Approximation

2020-04-30 · Paolo Di Lorenzo, Simone Scardapane

We study distributed stochastic nonconvex optimization in multi-agent networks. We introduce a novel algorithmic framework for the distributed minimization of the sum of the expected value of a smooth (possibly nonconvex…

Differentially Private ADMM for Convex Distributed Learning: Improved Accuracy via Multi-Step Approximation

2020-05-16 · Zonghao Huang, Yanmin Gong

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation …