paper-with-me

Papers

Distributed Optimization via Gradient Descent with Event-Triggered Zooming over Quantized Communication

2023-09-08 · Apostolos I. Rikos, Wei Jiang, Themistoklis Charalambous, Karl H. Johansson

In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and hence information should be quantized). Distributed methods in which nodes use quantized communication yield a solution at the proximity of the optimal solution, hence reaching an error floor that depends on the quantization level used; the finer the quantization the lower the error floor. However, it is not possible to determine in advance the optimal quantization level that ensures specific performance guarantees (such as achieving an error floor below a predefined threshold). Choosing a very small quantization level that would guarantee the desired performance, requires {information} packets of very large size, which is not desirable (could increase the probability of packet losses, increase delays, etc) and often not feasible due to the limited capacity of the channels available. In order to obtain a communication-efficient distributed solution and a sufficiently close proximity to the optimal solution, we propose a quantized distributed optimization algorithm that converges in a finite number of steps and is able to adjust the quantization level accordingly. The proposed solution uses a finite-time distributed optimization protocol to find a solution to the problem for a given quantization level in a finite number of steps and keeps refining the quantization level until the difference in the solution between two successive solutions with different quantization levels is below a certain pre-specified threshold.

📄 PDF Abstract BibTeX arXiv:2309.04588

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed OptimizationQuantization

Similar Papers 제목 키워드 기반

Distributed Deep Learning with Event-Triggered Communication

2019-09-08 · Jemin George, Prudhvi Gurram

We develop a Distributed Event-Triggered Stochastic GRAdient Descent (DETSGRAD) algorithm for solving non-convex optimization problems typically encountered in distributed deep learning. We propose a novel communication …

Deep Learning

Distributed State Estimation with Deep Neural Networks for Uncertain Nonlinear Systems under Event-Triggered Communication

2022-02-03 · Federico M. Zegers, Runhan Sun, Girish Chowdhary, Warren E. Dixon

Distributed state estimation is examined for a sensor network tasked with reconstructing a system's state through the use of a distributed and event-triggered observer. Each agent in the sensor network employs a deep neu…

State Estimation

AET-SGD: Asynchronous Event-triggered Stochastic Gradient Descent

2021-12-27 · Nhuong Nguyen, Song Han

Communication cost is the main bottleneck for the design of effective distributed learning algorithms. Recently, event-triggered techniques have been proposed to reduce the exchanged information among compute nodes and t…

When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize

2026-05-07 · Yi Wang, Chandrajit Bajaj arxiv

Fixed-budget nonconvex optimization can fail not because local descent is unstable, but because it is too stable: after reaching a nearby stationary point, an optimizer may spend the remaining evaluations refining an uni…

Distributed Optimization with Efficient Communication, Event-Triggered Solution Enhancement, and Operation Stopping

2025-04-23 · Apostolos I. Rikos, Wei Jiang, Themistoklis Charalambous, Karl H. Johansson

In modern large-scale systems with sensor networks and IoT devices it is essential to collaboratively solve complex problems while utilizing network resources efficiently. In our paper we present three distributed optimi…

Distributed OptimizationQuantizationSensor Fusion