paper-with-me

홈 › Papers

When unlearning is free: leveraging low influence points to reduce computational costs

2025-12-04 · Anat Kleiman, Robert Fisher, Ben Deaner, Udi Wieder arxiv

As concerns around data privacy in machine learning grow, the ability to unlearn, or remove, specific data points from trained models becomes increasingly important. While state of the art unlearning methods have emerged in response, they typically treat all points in the forget set equally. In this work, we challenge this approach by asking whether points that have a negligible impact on the model's learning need to be removed. Through a comparative analysis of influence functions across language and vision tasks, we identify subsets of training data with negligible impact on model outputs. Leveraging this insight, we propose an efficient unlearning framework that reduces the size of datasets before unlearning leading to significant computational savings (up to approximately 50 percent) on real world empirical examples.

📄 PDF Abstract BibTeX arXiv:2512.05254

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Model State Arithmetic for Machine Unlearning

2025-06-26 · Keivan Rezaei, Mehrdad Saberi, Abhilasha Ravichander, Soheil Feizi

Large language models are trained on massive corpora of web data, which may include private data, copyrighted material, factually inaccurate data, or data that degrades model performance. Eliminating the influence of suc…

Machine Unlearningmodel

Delta-Influence: Unlearning Poisons via Influence Functions

2024-11-20 · Wenjie Li, Jiawei Li, Christian Schroeder de Witt, Ameya Prabhu 외

Addressing data integrity challenges, such as unlearning the effects of data poisoning after model training, is necessary for the reliable deployment of machine learning models. State-of-the-art influence functions, such…

AttributeBenchmarkingData Poisoning

IMU: Influence-guided Machine Unlearning

2025-08-03 · Xindi Fan, Jing Wu, Mingyi Zhou, Pengwei Liang 외 arxiv

Machine Unlearning (MU) aims to selectively erase the influence of specific data points from pretrained models. However, most existing MU methods rely on the retain set to preserve model utility, which is often impractic…

Contrastive Unlearning: A Contrastive Approach to Machine Unlearning

2024-01-19 · Hong kyu Lee, Qiuchen Zhang, Carl Yang, Jian Lou 외

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting…

Machine UnlearningRepresentation Learning

Machine Unlearning of Features and Labels

2021-08-26 · Alexander Warnecke, Lukas Pirch, Christian Wressnegger, Konrad Rieck

Removing information from a machine learning model is a non-trivial task that requires to partially revert the training process. This task is unavoidable when sensitive data, such as credit card numbers or passwords, acc…

Machine Unlearning