paper-with-me

홈 › Papers

Decentralized Singular Value Decomposition for Large-scale Distributed Sensor Networks

2024-08-26 · Yufan Fan, Marius Pesavento

This article studies the problem of decentralized Singular Value Decomposition (d-SVD), which is fundamental in various signal processing applications. Two scenarios are considered depending on the availability of the data matrix under consideration. In the first scenario, the matrix of interest is row-wisely available in each local node in the network. In the second scenario, the matrix of interest implicitly forms an outer product from two different series of measurements. By combining the lightweight local rational function approximation approach with parallel averaging consensus algorithms, two d-SVD algorithms are proposed to cope with the two aforementioned scenarios. We evaluate the proposed algorithms using two application examples: decentralized sensor localization via low-rank matrix completion and decentralized passive radar detection. Moreover, a novel and non-trivial truncation technique, which employs a representative vector that is orthonormal to the principal signal subspace, is proposed to further reduce the communication cost associated with the d-SVD algorithms. Simulation results show that the proposed d-SVD algorithms converge to the centralized solution with reduced communication cost compared to those facilitated with the state-of-the-art decentralized power method.

📄 PDF Abstract BibTeX arXiv:2408.14292

Code (0)

등록된 구현이 없습니다.

Tasks

Low-Rank Matrix CompletionMatrix Completion

Similar Papers 제목 키워드 기반

Tail-Net: Extracting Lowest Singular Triplets for Big Data Applications

2021-04-28 · Gurpreet Singh, Soumyajit Gupta

SVD serves as an exploratory tool in identifying the dominant features in the form of top rank-r singular factors corresponding to the largest singular values. For Big Data applications it is well known that Singular Val…

ClusteringCommunity Detection

A random algorithm for low-rank decomposition of large-scale matrices with missing entries

2014-11-04 · Yiguang Liu

A Random SubMatrix method (RSM) is proposed to calculate the low-rank decomposition of large-scale matrices with known entry percentage \rho. RSM is very fast as the floating-point operations (flops) required are compare…

The Singular Value Decomposition, Applications and Beyond

2015-10-29 · Zhihua Zhang

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basi…

BIG-bench Machine LearningMatrix Completion

Analytical singular value decomposition for a class of stoichiometry matrices

2021-04-28 · Jacqueline M. Wentz, David M. Bortz

We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common…

SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression

2024-03-12 · Xin Wang, Yu Zheng, Zhongwei Wan, Mi Zhang

The advancements in Large Language Models (LLMs) have been hindered by their substantial sizes, which necessitate LLM compression methods for practical deployment. Singular Value Decomposition (SVD) offers a promising so…

Language ModelingLanguage ModellingLarge Language ModelModel Compression