paper-with-me

홈 › Papers

Local Differential Privacy is Not Enough: A Sample Reconstruction Attack against Federated Learning with Local Differential Privacy

2025-02-12 · Zhichao You, Xuewen Dong, Shujun Li, Ximeng Liu, Siqi Ma, Yulong Shen

Reconstruction attacks against federated learning (FL) aim to reconstruct users' samples through users' uploaded gradients. Local differential privacy (LDP) is regarded as an effective defense against various attacks, including sample reconstruction in FL, where gradients are clipped and perturbed. Existing attacks are ineffective in FL with LDP since clipped and perturbed gradients obliterate most sample information for reconstruction. Besides, existing attacks embed additional sample information into gradients to improve the attack effect and cause gradient expansion, leading to a more severe gradient clipping in FL with LDP. In this paper, we propose a sample reconstruction attack against LDP-based FL with any target models to reconstruct victims' sensitive samples to illustrate that FL with LDP is not flawless. Considering gradient expansion in reconstruction attacks and noise in LDP, the core of the proposed attack is gradient compression and reconstructed sample denoising. For gradient compression, an inference structure based on sample characteristics is presented to reduce redundant gradients against LDP. For reconstructed sample denoising, we artificially introduce zero gradients to observe noise distribution and scale confidence interval to filter the noise. Theoretical proof guarantees the effectiveness of the proposed attack. Evaluations show that the proposed attack is the only attack that reconstructs victims' training samples in LDP-based FL and has little impact on the target model's accuracy. We conclude that LDP-based FL needs further improvements to defend against sample reconstruction attacks effectively.

📄 PDF Abstract BibTeX arXiv:2502.08151

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingFederated LearningReconstruction Attack

Methods 이 논문이 사용한 방법론

Gradient Clipping One difficulty that arises with optimization of deep neural networks is that large parameter gradients can lead an SGD optimizer to update…

Similar Papers 제목 키워드 기반

Protection Against Reconstruction and Its Applications in Private Federated Learning

2018-12-03 · Abhishek Bhowmick, John Duchi, Julien Freudiger, Gaurav Kapoor 외

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this …

Federated Learningimage-classificationImage Classification

Defending against Reconstruction Attacks with Rényi Differential Privacy

2022-02-15 · Pierre Stock, Igor Shilov, Ilya Mironov, Alexandre Sablayrolles

Reconstruction attacks allow an adversary to regenerate data samples of the training set using access to only a trained model. It has been recently shown that simple heuristics can reconstruct data samples from language …

Universal Exact Compression of Differentially Private Mechanisms

2024-05-28 · Yanxiao Liu, Wei-Ning Chen, Ayfer Özgür, Cheuk Ting Li

To reduce the communication cost of differential privacy mechanisms, we introduce a novel construction, called Poisson private representation (PPR), designed to compress and simulate any local randomizer while ensuring l…

Classification under local differential privacy

2019-12-10 · Thomas Berrett, Cristina Butucea

We consider the binary classification problem in a setup that preserves the privacy of the original sample. We provide a privacy mechanism that is locally differentially private and then construct a classifier based on t…

Binary ClassificationClassificationGeneral Classification

Assessing Differentially Private Variational Autoencoders under Membership Inference

2022-04-16 · Daniel Bernau, Jonas Robl, Florian Kerschbaum

We present an approach to quantify and compare the privacy-accuracy trade-off for differentially private Variational Autoencoders. Our work complements previous work in two aspects. First, we evaluate the the strong reco…

Time SeriesTime Series Analysis