paper-with-me

홈 › Papers

Privacy-Preserving Distributed Optimization via Subspace Perturbation: A General Framework

2020-04-29 · Qiongxiu Li, Richard Heusdens, Mads Græsbøll Christensen

As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal processing techniques is the issue of privacy in handling sensitive data. To address this privacy issue, we propose a novel yet general subspace perturbation method for privacy-preserving distributed optimization, which allows each node to obtain the desired solution while protecting its private data. In particular, we show that the dual variables introduced in each distributed optimizer will not converge in a certain subspace determined by the graph topology. Additionally, the optimization variable is ensured to converge to the desired solution, because it is orthogonal to this non-convergent subspace. We therefore propose to insert noise in the non-convergent subspace through the dual variable such that the private data are protected, and the accuracy of the desired solution is completely unaffected. Moreover, the proposed method is shown to be secure under two widely-used adversary models: passive and eavesdropping. Furthermore, we consider several distributed optimizers such as ADMM and PDMM to demonstrate the general applicability of the proposed method. Finally, we test the performance through a set of applications. Numerical tests indicate that the proposed method is superior to existing methods in terms of several parameters like estimated accuracy, privacy level, communication cost and convergence rate.

📄 PDF Abstract BibTeX arXiv:2004.13999

Code (1)

qiongxiu/PrivacyOptimizationSubspace 공식 구현

Tasks

Distributed OptimizationPrivacy Preserving

Similar Papers 제목 키워드 기반

Privacy-Preserving Distributed Optimisation using Stochastic PDMM

2023-12-13 · Sebastian O. Jordan, Qiongxiu Li, Richard Heusdens

Privacy-preserving distributed processing has received considerable attention recently. The main purpose of these algorithms is to solve certain signal processing tasks over a network in a decentralised fashion without r…

Privacy Preserving

Privacy-Preserving Distributed Expectation Maximization for Gaussian Mixture Model using Subspace Perturbation

2022-09-16 · Qiongxiu Li, Jaron Skovsted Gundersen, Katrine Tjell, Rafal Wisniewski 외

Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federa…

Federated LearningPrivacy Preserving

Differentially Private Distributed Convex Optimization

2023-02-28 · Minseok Ryu, Kibaek Kim

This paper considers distributed optimization (DO) where multiple agents cooperate to minimize a global objective function, expressed as a sum of local objectives, subject to some constraints. In DO, each agent iterative…

Distributed OptimizationFederated LearningPrivacy Preserving

Privacy-Preserving Distributed Zeroth-Order Optimization

2020-08-31 · C. Gratton, N. K. D. Venkategowda, R. Arablouei, S. Werner

We develop a privacy-preserving distributed algorithm to minimize a regularized empirical risk function when the first-order information is not available and data is distributed over a multi-agent network. We employ a ze…

Privacy Preserving

Privacy-Preserving Text Sanitization for Distributed Agents Collaboration via Disentangled Representations

2026-06-13 · Xuan Liu, Hefeng Zhou, Sicheng Chen, Chao Yang 외 arxiv

When distributed agents exchange text across organizational boundaries, privacy leakage arises not only from explicit identifiers but also from distributional signatures such as formatting conventions, vocabulary choices…