paper-with-me

홈 › Papers

SCRUB-FL: Sanitizing and Cleansing Representations via Unlearning of Backdoors

2026-06-21 · Osama Wehbi, Sarhad Arisdakessian, Omar Abdel Wahab, Azzam Mourad, Hadi Otrok arxiv

Federated Learning (FL) enables collaborative model training without sharing raw data, making it a promising paradigm for privacy-sensitive applications. However, its decentralized nature makes it inherently vulnerable to backdoor attacks, where malicious clients embed hidden triggers into local training data to manipulate model predictions. Existing defenses mainly operate during before and during aggregation cannot fully eliminate backdoor behaviors that persist in the converged global model. Moreover, the effectiveness of post-training sanitization is often limited by the server's lack of knowledge of trigger patterns or poisoned clients after convergence, resulting in residual backdoor behaviors or accuracy degradation due to neuron entanglement. To address this limitation, we propose SCRUB-FL (Sanitizing and Cleansing Representations via Unlearning of Backdoors), a two-phase solution for post-training backdoor removal in FL. During training, clients identify suspicious samples using spectral analysis and activation clustering, then train lightweight Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) models to capture trigger-related distributions. The generator parameters are aggregated server-side to construct a global representation of suspicious patterns without exposing raw data. After convergence, the server synthesizes trigger-approximating samples and applies machine unlearning to erase the trigger-target association by redistributing predictions toward a uniform distribution. Experimental evaluations on CIFAR-10 and GTSRB across three attack types and up to 40% malicious participation demonstrate that SCRUB-FL reduces the backdoor attack success rate to as low as 3.88% while maintaining over 91% normal task accuracy, outperforming state-of-the-art defenses without requiring prior trigger knowledge or a large clean proxy dataset at the server.

📄 PDF Abstract BibTeX arXiv:2606.22700

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Unlearning via Sparse Representations

2023-11-26 · Vedant Shah, Frederik Träuble, Ashish Malik, Hugo Larochelle 외

Machine \emph{unlearning}, which involves erasing knowledge about a \emph{forget set} from a trained model, can prove to be costly and infeasible by existing techniques. We propose a nearly compute-free zero-shot unlearn…

Knowledge Distillation

Towards Unbounded Machine Unlearning

2023-02-20 · NeurIPS 2023 11 · Meghdad Kurmanji, Peter Triantafillou, Jamie Hayes, Eleni Triantafillou

Deep machine unlearning is the problem of `removing' from a trained neural network a subset of its training set. This problem is very timely and has many applications, including the key tasks of removing biases (RB), res…

Inference AttackMachine UnlearningMembership Inference Attack

Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs

2026-06-02 · Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia 외 arxiv

Backdoor attacks in Large Language Models (LLMs) are a growing security concern, where models can generate adversary-chosen content. Existing defenses target backdoors one at a time and typically require knowledge of the…

Continual Pretraining

Get Rid Of Your Trail: Remotely Erasing Backdoors in Federated Learning

2023-04-20 · Manaar Alam, Hithem Lamri, Michail Maniatakos

Federated Learning (FL) enables collaborative deep learning training across multiple participants without exposing sensitive personal data. However, the distributed nature of FL and the unvetted participants' data makes …

Federated Learningimage-classificationImage ClassificationMachine Unlearning

REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space

2024-06-13 · Tomer Ashuach, Martin Tutek, Yonatan Belinkov

Language models (LMs) risk inadvertently memorizing and divulging sensitive or personally identifiable information (PII) seen in training data, causing privacy concerns. Current approaches to address this issue involve c…

Model Editing