Fast Decentralized Linear Functions Over Edge Fluctuating Graphs
Implementing linear transformations is a key task in the decentralized signal processing framework, which performs learning tasks on data sets distributed over multi-node networks. That kind of network can be represented by a graph. Recently, some decentralized methods have been proposed to compute linear transformations by leveraging the notion of graph shift operator, which captures the local structure of the graph. However, existing approaches have some drawbacks such as considering some special instances of linear transformations, or reducing the family of transformations by assuming that a shift matrix is given such that a subset of its eigenvectors spans the subspace of interest. In contrast, this paper develops a framework for computing a wide class of linear transformations in a decentralized fashion by relying on the notion of graph shift operator. The main goal of the proposed method is to compute the desired linear transformation in a small number of iterations. To this end, a set of successive graph shift operators is employed, then, a new optimization problem is proposed whose goal is to compute the desired transformation as fast as possible. In addition, usually, the topology of the networks, especially the wireless sensor networks, change randomly because of node failures or random links. In this paper, the effect of edge fluctuations on the performance of the proposed method is studied. To deal with the negative effect of edge fluctuations, an online kernel-based method is proposed which enables nodes to estimate the missed values with their at hand information. The proposed method can also be employed to sparsify the network graph or reduce the number of local exchanges between nodes, which saves sensors power in the wireless sensor networks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Koopman System Approximation Based Optimal Control of Multiple Robots -- Part II: Simulations and Evaluations
This report presents the results of a simulation study of the linear model and bilinear model approximations of the Koopman system model of the nonlinear utility functions in optimal control of a 3-robot system. In such …
On linear convergence of two decentralized algorithms
Decentralized algorithms solve multi-agent problems over a connected network, where the information can only be exchanged with the accessible neighbors. Though there exist several decentralized optimization algorithms, t…
Vocal Bursts Valence PredictionA Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features
This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in ma…
regressionFast decentralized non-convex finite-sum optimization with recursive variance reduction
This paper considers decentralized minimization of $N:=nm$ smooth non-convex cost functions equally divided over a directed network of $n$ nodes. Specifically, we describe a stochastic first-order gradient method, called…
Communication-Efficient Variance-Reduced Decentralized Stochastic Optimization over Time-Varying Directed Graphs
We consider the problem of decentralized optimization over time-varying directed networks. The network nodes can access only their local objectives, and aim to collaboratively minimize a global function by exchanging mes…
Stochastic Optimization