paper-with-me

Papers

Partially Blinded Unlearning: Class Unlearning for Deep Networks a Bayesian Perspective

2024-03-24 · Subhodip Panda, Shashwat Sourav, Prathosh A. P

In order to adhere to regulatory standards governing individual data privacy and safety, machine learning models must systematically eliminate information derived from specific subsets of a user's training data that can no longer be utilized. The emerging discipline of Machine Unlearning has arisen as a pivotal area of research, facilitating the process of selectively discarding information designated to specific sets or classes of data from a pre-trained model, thereby eliminating the necessity for extensive retraining from scratch. The principal aim of this study is to formulate a methodology tailored for the purposeful elimination of information linked to a specific class of data from a pre-trained classification network. This intentional removal is crafted to degrade the model's performance specifically concerning the unlearned data class while concurrently minimizing any detrimental impacts on the model's performance in other classes. To achieve this goal, we frame the class unlearning problem from a Bayesian perspective, which yields a loss function that minimizes the log-likelihood associated with the unlearned data with a stability regularization in parameter space. This stability regularization incorporates Mohalanobis distance with respect to the Fisher Information matrix and $l_2$ distance from the pre-trained model parameters. Our novel approach, termed \textbf{Partially-Blinded Unlearning (PBU)}, surpasses existing state-of-the-art class unlearning methods, demonstrating superior effectiveness. Notably, PBU achieves this efficacy without requiring awareness of the entire training dataset but only to the unlearned data points, marking a distinctive feature of its performance.

📄 PDF Abstract BibTeX arXiv:2403.16246

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Unlearning

Similar Papers 제목 키워드 기반

Deep Regression Unlearning

2022-10-15 · Ayush K Tarun, Vikram S Chundawat, Murari Mandal, Mohan Kankanhalli

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developme…

Inference AttackMachine UnlearningMembership Inference Attackregression

Challenges and Pitfalls of Bayesian Unlearning

2022-07-07 · Ambrish Rawat, James Requeima, Wessel Bruinsma, Richard Turner

Machine unlearning refers to the task of removing a subset of training data, thereby removing its contributions to a trained model. Approximate unlearning are one class of methods for this task which avoid the need to re…

Machine UnlearningVariational Inference

Mitigating Privacy Risk via Forget Set-Free Unlearning

2026-04-12 · Aviraj Newatia, Michael Cooper, Viet Nguyen, Rahul G. Krishnan arxiv

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as databa…

Variational Bayesian Unlearning

2020-10-24 · NeurIPS 2020 12 · Quoc Phong Nguyen, Bryan Kian Hsiang Low, Patrick Jaillet

This paper studies the problem of approximately unlearning a Bayesian model from a small subset of the training data to be erased. We frame this problem as one of minimizing the Kullback-Leibler divergence between the ap…

Variational Inference

A unified PAC-Bayesian framework for machine unlearning via information risk minimization

2021-06-01 · Sharu Theresa Jose, Osvaldo Simeone

Machine unlearning refers to mechanisms that can remove the influence of a subset of training data upon request from a trained model without incurring the cost of re-training from scratch. This paper develops a unified P…

Machine Unlearning