paper-with-me

홈 › Papers

The Unseen Threat: Residual Knowledge in Machine Unlearning under Perturbed Samples

2026-01-29 · Hsiang Hsu, Pradeep Niroula, Zichang He, Ivan Brugere, Freddy Lecue, Chun-Fu Chen arxiv

Machine unlearning offers a practical alternative to avoid full model re-training by approximately removing the influence of specific user data. While existing methods certify unlearning via statistical indistinguishability from re-trained models, these guarantees do not naturally extend to model outputs when inputs are adversarially perturbed. In particular, slight perturbations of forget samples may still be correctly recognized by the unlearned model - even when a re-trained model fails to do so - revealing a novel privacy risk: information about the forget samples may persist in their local neighborhood. In this work, we formalize this vulnerability as residual knowledge and show that it is inevitable in high-dimensional settings. To mitigate this risk, we propose a fine-tuning strategy, named RURK, that penalizes the model's ability to re-recognize perturbed forget samples. Experiments on vision benchmarks with deep neural networks demonstrate that residual knowledge is prevalent across existing unlearning methods and that our approach effectively prevents residual knowledge.

📄 PDF Abstract BibTeX arXiv:2601.22359

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Verifying Robust Unlearning: Probing Residual Knowledge in Unlearned Models

2025-04-21 · Hao Xuan, Xingyu Li

Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed kno…

Machine Unlearning

Threats, Attacks, and Defenses in Machine Unlearning: A Survey

2024-03-20 · Ziyao Liu, Huanyi Ye, Chen Chen, Yongsen Zheng 외

Machine Unlearning (MU) has recently gained considerable attention due to its potential to achieve Safe AI by removing the influence of specific data from trained Machine Learning (ML) models. This process, known as know…

Machine UnlearningMisinformationSurvey

Auditing Language Model Unlearning via Information Decomposition

2026-01-21 · Anmol Goel, Alan Ritter, Iryna Gurevych arxiv

We expose a critical limitation in current approaches to machine unlearning in language models: despite the apparent success of unlearning algorithms, information about the forgotten data remains linearly decodable from …

Machine Unlearning on Pre-trained Models by Residual Feature Alignment Using LoRA

2024-11-13 · Laiqiao Qin, Tianqing Zhu, LinLin Wang, Wanlei Zhou

Machine unlearning is new emerged technology that removes a subset of the training data from a trained model without affecting the model performance on the remaining data. This topic is becoming increasingly important in…

Machine Unlearning

Survey of Security and Data Attacks on Machine Unlearning In Financial and E-Commerce

2024-09-29 · Carl E. J. Brodzinski

This paper surveys the landscape of security and data attacks on machine unlearning, with a focus on financial and e-commerce applications. We discuss key privacy threats such as Membership Inference Attacks and Data Rec…

Data PoisoningMachine Unlearning