A few-shot Label Unlearning in Vertical Federated Learning

2024-10-14 · Hanlin Gu, Hong Xi Tae, Chee Seng Chan, Lixin Fan

This paper addresses the critical challenge of unlearning in Vertical Federated Learning (VFL), an area that has received limited attention compared to horizontal federated learning. We introduce the first approach specifically designed to tackle label unlearning in VFL, focusing on scenarios where the active party aims to mitigate the risk of label leakage. Our method leverages a limited amount of labeled data, utilizing manifold mixup to augment the forward embedding of insufficient data, followed by gradient ascent on the augmented embeddings to erase label information from the models. This combination of augmentation and gradient ascent enables high unlearning effectiveness while maintaining efficiency, completing the unlearning procedure within seconds. Extensive experiments conducted on diverse datasets, including MNIST, CIFAR10, CIFAR100, and ModelNet, validate the efficacy and scalability of our approach. This work represents a significant advancement in federated learning, addressing the unique challenges of unlearning in VFL while preserving both privacy and computational efficiency.

📄 PDF Abstract BibTeX arXiv:2410.10922

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency Federated LearningVertical Federated Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Manifold Mixup Manifold Mixup is a regularization method that encourages neural networks to predict less confidently on interpolations of hidden representations. It leverages semantic…

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Certifying the Right to Be Forgotten: Primal-Dual Optimization for Sample and Label Unlearning in Vertical Federated Learning

2025-12-29 · Yu Jiang, Xindi Tong, Ziyao Liu, Xiaoxi Zhang 외 arxiv

Federated unlearning has become an attractive approach to address privacy concerns in collaborative machine learning, for situations when sensitive data is remembered by AI models during the machine learning process. It …

Federated Learning

Forgetting Any Data at Any Time: A Theoretically Certified Unlearning Framework for Vertical Federated Learning

2025-02-24 · Linian Wang, Leye Wang

Privacy concerns in machine learning are heightened by regulations such as the GDPR, which enforces the "right to be forgotten" (RTBF), driving the emergence of machine unlearning as a critical research field. Vertical F…

Federated Learning Machine Unlearning Vertical Federated Learning

Unlearning Clients, Features and Samples in Vertical Federated Learning

2025-01-23 · Ayush K. Varshney, Konstantinos Vandikas, Vicenç Torra

Federated Learning (FL) has emerged as a prominent distributed learning paradigm. Within the scope of privacy preservation, information privacy regulations such as GDPR entitle users to request the removal (or unlearning…

Federated Learning Inference Attack Knowledge Distillation Membership Inference Attack+1

REMISVFU: Vertical Federated Unlearning via Representation Misdirection for Intermediate Output Feature

2025-12-11 · Wenhan Wu, Zhili He, Huanghuang Liang, Yili Gong 외 arxiv

Data-protection regulations such as the GDPR grant every participant in a federated system a right to be forgotten. Federated unlearning has therefore emerged as a research frontier, aiming to remove a specific party's c…