paper-with-me

Papers

Revisiting Randomized Gossip Algorithms: General Framework, Convergence Rates and Novel Block and Accelerated Protocols

2019-05-20 · Nicolas Loizou, Peter Richtárik

In this work we present a new framework for the analysis and design of randomized gossip algorithms for solving the average consensus problem. We show how classical randomized iterative methods for solving linear systems can be interpreted as gossip algorithms when applied to special systems encoding the underlying network and explain in detail their decentralized nature. Our general framework recovers a comprehensive array of well-known gossip algorithms as special cases, including the pairwise randomized gossip algorithm and path averaging gossip, and allows for the development of provably faster variants. The flexibility of the new approach enables the design of a number of new specific gossip methods. For instance, we propose and analyze novel block and the first provably accelerated randomized gossip protocols, and dual randomized gossip algorithms. From a numerical analysis viewpoint, our work is the first that explores in depth the decentralized nature of randomized iterative methods for linear systems and proposes them as methods for solving the average consensus problem. We evaluate the performance of the proposed gossip protocols by performing extensive experimental testing on typical wireless network topologies.

📄 PDF Abstract BibTeX arXiv:1905.08645

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Provably Accelerated Randomized Gossip Algorithms

2018-10-31 · Nicolas Loizou, Michael Rabbat, Peter Richtárik

In this work we present novel provably accelerated gossip algorithms for solving the average consensus problem. The proposed protocols are inspired from the recently developed accelerated variants of the randomized Kaczm…

Accelerated Gossip via Stochastic Heavy Ball Method

2018-09-23 · Nicolas Loizou, Peter Richtárik

In this paper we show how the stochastic heavy ball method (SHB) -- a popular method for solving stochastic convex and non-convex optimization problems --operates as a randomized gossip algorithm. In particular, we focus…

A Privacy Preserving Randomized Gossip Algorithm via Controlled Noise Insertion

2019-01-27 · Filip Hanzely, Jakub Konečný, Nicolas Loizou, Peter Richtárik 외

In this work we present a randomized gossip algorithm for solving the average consensus problem while at the same time protecting the information about the initial private values stored at the nodes. We give iteration co…

Privacy Preserving

A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip

2021-06-10 · Mathieu Even, Raphaël Berthier, Francis Bach, Nicolas Flammarion 외

We introduce the continuized Nesterov acceleration, a close variant of Nesterov acceleration whose variables are indexed by a continuous time parameter. The two variables continuously mix following a linear ordinary diff…

Accelerated Decentralized Optimization with Local Updates for Smooth and Strongly Convex Objectives

2018-10-05 · Hadrien Hendrikx, Francis Bach, Laurent Massoulié

In this paper, we study the problem of minimizing a sum of smooth and strongly convex functions split over the nodes of a network in a decentralized fashion. We propose the algorithm $ESDACD$, a decentralized accelerated…