Federated Unlearning with Knowledge Distillation

2022-01-24 · Chen Wu, Sencun Zhu, Prasenjit Mitra

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the training data. With the recent legislation on right to be forgotten, it is crucially essential for the FL model to possess the ability to forget what it has learned from each client. We propose a novel federated unlearning method to eliminate a client's contribution by subtracting the accumulated historical updates from the model and leveraging the knowledge distillation method to restore the model's performance without using any data from the clients. This method does not have any restrictions on the type of neural networks and does not rely on clients' participation, so it is practical and efficient in the FL system. We further introduce backdoor attacks in the training process to help evaluate the unlearning effect. Experiments on three canonical datasets demonstrate the effectiveness and efficiency of our method.

📄 PDF Abstract BibTeX arXiv:2201.09441

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning Knowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Forgetting to Witness: Efficient Federated Unlearning and Its Visible Evaluation

2026-04-06 · Houzhe Wang, Xiaojie Zhu, Chi Chen arxiv

With the increasing importance of data privacy and security, federated unlearning has emerged as a novel research field dedicated to ensuring that federated learning models no longer retain or leak relevant information o…

Knowledge Distillation Federated Learning

Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning

2023-02-04 · Xiangrong Zhu, Guangyao Li, Wei Hu

Federated Learning (FL) recently emerges as a paradigm to train a global machine learning model across distributed clients without sharing raw data. Knowledge Graph (KG) embedding represents KGs in a continuous vector sp…

Federated Learning Graph Embedding Knowledge Distillation Knowledge Graph Embedding+1

QuickDrop: Efficient Federated Unlearning by Integrated Dataset Distillation

2023-11-27 · Akash Dhasade, Yaohong Ding, Song Guo, Anne-Marie Kermarrec 외

Federated Unlearning (FU) aims to delete specific training data from an ML model trained using Federated Learning (FL). We introduce QuickDrop, an efficient and original FU method that utilizes dataset distillation (DD) …

Dataset Distillation Federated Learning

Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement

2026-04-05 · Houzhe Wang, Xiaojie Zhu, Chi Chen arxiv

With the increasing importance of data privacy and security, federated unlearning emerges as a new research field dedicated to ensuring that once specific data is deleted, federated learning models no longer retain or di…

Synthetic Data Generation Federated Learning

Unlearning through Knowledge Overwriting: Reversible Federated Unlearning via Selective Sparse Adapter

2025-01-01 · CVPR 2025 1 · Zhengyi Zhong, Weidong Bao, Ji Wang, Shuai Zhang 외

Federated Learning is a promising paradigm for privacy-preserving collaborative model training. In practice, it is essential not only to continuously train the model to acquire new knowledge but also to guarantee old…

Federated Learning Privacy Preserving