paper-with-me

Papers

Provable Reduction in Communication Rounds for Non-Smooth Convex Federated Learning

2025-03-27 · Karlo Palenzuela, Ali Dadras, Alp Yurtsever, Tommy Löfstedt

Multiple local steps are key to communication-efficient federated learning. However, theoretical guarantees for such algorithms, without data heterogeneity-bounding assumptions, have been lacking in general non-smooth convex problems. Leveraging projection-efficient optimization methods, we propose FedMLS, a federated learning algorithm with provable improvements from multiple local steps. FedMLS attains an $\epsilon$-suboptimal solution in $\mathcal{O}(1/\epsilon)$ communication rounds, requiring a total of $\mathcal{O}(1/\epsilon^2)$ stochastic subgradient oracle calls.

📄 PDF Abstract BibTeX arXiv:2503.21627

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Federated Accelerated Stochastic Gradient Descent

2020-06-16 · NeurIPS 2020 12 · Honglin Yuan, Tengyu Ma

We propose Federated Accelerated Stochastic Gradient Descent (FedAc), a principled acceleration of Federated Averaging (FedAvg, also known as Local SGD) for distributed optimization. FedAc is the first provable accelerat…

Distributed Optimization

A Proximal Gradient Method With Probabilistic Multi-Gossip Communications for Decentralized Composite Optimization

2023-12-19 · Luyao Guo, Luqing Wang, Xinli Shi, Jinde Cao

Decentralized optimization methods with local updates have recently gained attention for their provable ability to communication acceleration. In these methods, nodes perform several iterations of local computations betw…

Distributed Optimization

LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning

2018-05-25 · NeurIPS 2018 12 · Tianyi Chen, Georgios B. Giannakis, Tao Sun, Wotao Yin

This paper presents a new class of gradient methods for distributed machine learning that adaptively skip the gradient calculations to learn with reduced communication and computation. Simple rules are designed to detect…

Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity

2024-05-25 · Qihao Zhou, Haishan Ye, Luo Luo

This paper considers the distributed convex-concave minimax optimization under the second-order similarity. We propose stochastic variance-reduced optimistic gradient sliding (SVOGS) method, which takes the advantage of …

A Provably Communication-Efficient Asynchronous Distributed Inference Method for Convex and Nonconvex Problems

2019-03-16 · Jineng Ren, Jarvis Haupt

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iterat…

Distributed Optimization