Learning to Unlearn for Robust Machine Unlearning
Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the overall performance of the model. Despite recent advances in this field, balancing between the dual objectives of unlearning remains challenging. From a fresh perspective of generalization, we introduce a novel Learning-to-Unlearn (LTU) framework, which adopts a meta-learning approach to optimize the unlearning process to improve forgetting and remembering in a unified manner. LTU includes a meta-optimization scheme that facilitates models to effectively preserve generalizable knowledge with only a small subset of the remaining set, while thoroughly forgetting the specific data samples. We also introduce a Gradient Harmonization strategy to align the optimization trajectories for remembering and forgetting via mitigating gradient conflicts, thus ensuring efficient and effective model updates. Our approach demonstrates improved efficiency and efficacy for MU, offering a promising solution to the challenges of data rights and model reusability.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine UnlearningMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Machine Unlearning: A Comprehensive Survey
As the right to be forgotten has been legislated worldwide, many studies attempt to design unlearning mechanisms to protect users' privacy when they want to leave machine learning service platforms. Specifically, machine…
Machine UnlearningSurveyZero-shot Class Unlearning via Layer-wise Relevance Analysis and Neuronal Path Perturbation
In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models w…
Machine UnlearningPrivacy PreservingReady2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
This paper introduces Ready2Unlearn, a learning-time optimization approach designed to facilitate future unlearning processes. Unlike the majority of existing unlearning efforts that focus on designing unlearning algorit…
Machine UnlearningMeta-LearningEfficient Machine Unlearning by Model Splitting and Core Sample Selection
Machine unlearning is essential for meeting legal obligations such as the right to be forgotten, which requires the removal of specific data from machine learning models upon request. While several approaches to unlearni…
Machine UnlearningTowards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems
Machine unlearning is a crucial tool for enabling a classification model to forget specific data that are used in the training time. Recently, various studies have presented machine unlearning algorithms and evaluated th…
Age EstimationAttributeClassificationFacial Attribute Classification+2