paper-with-me

홈 › Papers

Byzantine Outside, Curious Inside: Reconstructing Data Through Malicious Updates

2025-06-13 · Kai Yue, Richeng Jin, Chau-Wai Wong, Huaiyu Dai

Federated learning (FL) enables decentralized machine learning without sharing raw data, allowing multiple clients to collaboratively learn a global model. However, studies reveal that privacy leakage is possible under commonly adopted FL protocols. In particular, a server with access to client gradients can synthesize data resembling the clients' training data. In this paper, we introduce a novel threat model in FL, named the maliciously curious client, where a client manipulates its own gradients with the goal of inferring private data from peers. This attacker uniquely exploits the strength of a Byzantine adversary, traditionally aimed at undermining model robustness, and repurposes it to facilitate data reconstruction attack. We begin by formally defining this novel client-side threat model and providing a theoretical analysis that demonstrates its ability to achieve significant reconstruction success during FL training. To demonstrate its practical impact, we further develop a reconstruction algorithm that combines gradient inversion with malicious update strategies. Our analysis and experimental results reveal a critical blind spot in FL defenses: both server-side robust aggregation and client-side privacy mechanisms may fail against our proposed attack. Surprisingly, standard server- and client-side defenses designed to enhance robustness or privacy may unintentionally amplify data leakage. Compared to the baseline approach, a mistakenly used defense may instead improve the reconstructed image quality by 10-15%.

📄 PDF Abstract BibTeX arXiv:2506.11413

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningReconstruction Attack

Similar Papers 제목 키워드 기반

SABLE: Secure And Byzantine robust LEarning

2023-09-11 · Antoine Choffrut, Rachid Guerraoui, Rafael Pinot, Renaud Sirdey 외

Due to the widespread availability of data, machine learning (ML) algorithms are increasingly being implemented in distributed topologies, wherein various nodes collaborate to train ML models via the coordination of a ce…

Image ClassificationPrivacy Preserving

Brave: Byzantine-Resilient and Privacy-Preserving Peer-to-Peer Federated Learning

2024-01-10 · Zhangchen Xu, Fengqing Jiang, Luyao Niu, Jinyuan Jia 외

Federated learning (FL) enables multiple participants to train a global machine learning model without sharing their private training data. Peer-to-peer (P2P) FL advances existing centralized FL paradigms by eliminating …

Federated Learningimage-classificationImage ClassificationPrivacy Preserving

On the Tradeoff between Privacy Preservation and Byzantine-Robustness in Decentralized Learning

2023-08-28 · Haoxiang Ye, Heng Zhu, Qing Ling

This paper jointly considers privacy preservation and Byzantine-robustness in decentralized learning. In a decentralized network, honest-but-curious agents faithfully follow the prescribed algorithm, but expect to infer …

Privacy Preserving

Introducing 'Inside' Out of Distribution

2024-07-05 · Teddy Lazebnik

Detecting and understanding out-of-distribution (OOD) samples is crucial in machine learning (ML) to ensure reliable model performance. Current OOD studies, in general, and in the context of ML, in particular, primarily …

Which side are you on? Insider-Outsider classification in conspiracy-theoretic social media

2022-03-08 · ACL 2022 5 · Pavan Holur, Tianyi Wang, Shadi Shahsavari, Timothy Tangherlini 외

Social media is a breeding ground for threat narratives and related conspiracy theories. In these, an outside group threatens the integrity of an inside group, leading to the emergence of sharply defined group identities…

Language ModelingLanguage Modelling