paper-with-me

Papers

Machine Unlearning in Contrastive Learning

2024-05-12 · Zixin Wang, Kongyang Chen

Machine unlearning is a complex process that necessitates the model to diminish the influence of the training data while keeping the loss of accuracy to a minimum. Despite the numerous studies on machine unlearning in recent years, the majority of them have primarily focused on supervised learning models, leaving research on contrastive learning models relatively underexplored. With the conviction that self-supervised learning harbors a promising potential, surpassing or rivaling that of supervised learning, we set out to investigate methods for machine unlearning centered around contrastive learning models. In this study, we introduce a novel gradient constraint-based approach for training the model to effectively achieve machine unlearning. Our method only necessitates a minimal number of training epochs and the identification of the data slated for unlearning. Remarkably, our approach demonstrates proficient performance not only on contrastive learning models but also on supervised learning models, showcasing its versatility and adaptability in various learning paradigms.

📄 PDF Abstract BibTeX arXiv:2405.07317

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningMachine UnlearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Contrastive Unlearning: A Contrastive Approach to Machine Unlearning

2024-01-19 · Hong kyu Lee, Qiuchen Zhang, Carl Yang, Jian Lou 외

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting…

Machine UnlearningRepresentation Learning

Alignment Calibration: Machine Unlearning for Contrastive Learning under Auditing

2024-06-05 · Yihan Wang, Yiwei Lu, Guojun Zhang, Franziska Boenisch 외

Machine unlearning provides viable solutions to revoke the effect of certain training data on pre-trained model parameters. Existing approaches provide unlearning recipes for classification and generative models. However…

Contrastive LearningMachine Unlearning

WSS-CL: Weight Saliency Soft-Guided Contrastive Learning for Efficient Machine Unlearning Image Classification

2025-08-06 · Thang Duc Tran, Thai Hoang Le arxiv

Machine unlearning, the efficient deletion of the impact of specific data in a trained model, remains a challenging problem. Current machine unlearning approaches that focus primarily on data-centric or weight-based stra…

Contrastive LearningImage Classification

UCD: Unlearning in LLMs via Contrastive Decoding

2025-06-12 · Vinith M. Suriyakumar, Ayush Sekhari, Ashia Wilson

Machine unlearning aims to remove specific information, e.g. sensitive or undesirable content, from large language models (LLMs) while preserving overall performance. We propose an inference-time unlearning algorithm tha…

Machine Unlearning

Machine Unlearning in Hyperbolic vs. Euclidean Multimodal Contrastive Learning: Adapting Alignment Calibration to MERU

2025-03-19 · Àlex Pujol Vidal, Sergio Escalera, Kamal Nasrollahi, Thomas B. Moeslund

Machine unlearning methods have become increasingly important for selective concept removal in large pre-trained models. While recent work has explored unlearning in Euclidean contrastive vision-language models, the effe…

Contrastive LearningMachine Unlearning