paper-with-me

Papers

Gradient Obfuscation Gives a False Sense of Security in Federated Learning

2022-06-08 · Kai Yue, Richeng Jin, Chau-Wai Wong, Dror Baron, Huaiyu Dai

Federated learning has been proposed as a privacy-preserving machine learning framework that enables multiple clients to collaborate without sharing raw data. However, client privacy protection is not guaranteed by design in this framework. Prior work has shown that the gradient sharing strategies in federated learning can be vulnerable to data reconstruction attacks. In practice, though, clients may not transmit raw gradients considering the high communication cost or due to privacy enhancement requirements. Empirical studies have demonstrated that gradient obfuscation, including intentional obfuscation via gradient noise injection and unintentional obfuscation via gradient compression, can provide more privacy protection against reconstruction attacks. In this work, we present a new data reconstruction attack framework targeting the image classification task in federated learning. We show that commonly adopted gradient postprocessing procedures, such as gradient quantization, gradient sparsification, and gradient perturbation, may give a false sense of security in federated learning. Contrary to prior studies, we argue that privacy enhancement should not be treated as a byproduct of gradient compression. Additionally, we design a new method under the proposed framework to reconstruct the image at the semantic level. We quantify the semantic privacy leakage and compare with conventional based on image similarity scores. Our comparisons challenge the image data leakage evaluation schemes in the literature. The results emphasize the importance of revisiting and redesigning the privacy protection mechanisms for client data in existing federated learning algorithms.

📄 PDF Abstract BibTeX arXiv:2206.04055

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learningimage-classificationImage ClassificationPrivacy PreservingQuantizationReconstruction Attack

Similar Papers 제목 키워드 기반

Gradient Obfuscation Checklist Test Gives a False Sense of Security

2022-06-03 · Nikola Popovic, Danda Pani Paudel, Thomas Probst, Luc van Gool

One popular group of defense techniques against adversarial attacks is based on injecting stochastic noise into the network. The main source of robustness of such stochastic defenses however is often due to the obfuscati…

Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples

2018-02-01 · ICML 2018 7 · Anish Athalye, Nicholas Carlini, David Wagner

We identify obfuscated gradients, a kind of gradient masking, as a phenomenon that leads to a false sense of security in defenses against adversarial examples. While defenses that cause obfuscated gradients appear to def…

Adversarial AttackAdversarial Defense

Evaluating the Evaluators: Trust in Adversarial Robustness Tests

2025-07-04 · Antonio Emanuele Cinà, Maura Pintor, Luca Demetrio, Ambra Demontis 외

Despite significant progress in designing powerful adversarial evasion attacks for robustness verification, the evaluation of these methods often remains inconsistent and unreliable. Many assessments rely on mismatched m…

Adversarial Robustness

An Empirical Study of Code Obfuscation Practices in the Google Play Store

2025-02-07 · Akila Niroshan, Suranga Seneviratne, Aruna Seneviratne

The Android ecosystem is vulnerable to issues such as app repackaging, counterfeiting, and piracy, threatening both developers and users. To mitigate these risks, developers often employ code obfuscation techniques. Howe…

Investigating the Application of Common-Sense Knowledge-Base for Identifying Term Obfuscation in Adversarial Communication

2017-01-18 · Agarwal Swati, Sureka Ashish

Word obfuscation or substitution means replacing one word with another word in a sentence to conceal the textual content or communication. Word obfuscation is used in adversarial communication by terrorist or criminals f…

Common Sense ReasoningSentence