paper-with-me

Papers

Unlearning Targeted Information via Single Layer Unlearning Gradient

2024-07-16 · Zikui Cai, Yaoteng Tan, M. Salman Asif

Unauthorized privacy-related and copyrighted content generation using generative-AI is becoming a significant concern for human society, raising ethical, legal, and privacy issues that demand urgent attention. The EU's General Data Protection Regulation (GDPR) include a "right to be forgotten," which allows individuals to request the deletion of their personal data. However, this primarily applies to data stored in traditional databases, not AI models. Recently, machine unlearning techniques have arise that attempt to eliminate the influence of sensitive content used during AI model training, but they often require extensive updates to the deployed systems and incur substantial computational costs. In this work, we propose a novel and efficient method called Single Layer Unlearning Gradient (SLUG), that can unlearn targeted information by updating targeted layers of a model using a one-time gradient computation. Our method is highly modular and enables the selective removal of multiple sensitive concepts, such as celebrity names and copyrighted content, from the generated outputs of widely used foundation models (e.g., CLIP) and generative models (e.g., Stable Diffusion). Broadly, our method ensures AI-generated content complies with privacy regulations and intellectual property laws, fostering responsible use of generative models, mitigating legal risks and promoting a trustworthy, socially responsible AI ecosystem.

📄 PDF Abstract BibTeX arXiv:2407.11867

Code (1)

CSIPlab/slug 공식 구현 pytorch

Tasks

Machine Unlearning

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

SEPS: A Separability Measure for Robust Unlearning in LLMs

2025-05-20 · Wonje Jeung, Sangyeon Yoon, Albert No

Machine unlearning aims to selectively remove targeted knowledge from Large Language Models (LLMs), ensuring they forget specified content while retaining essential information. Existing unlearning metrics assess whether…

Machine Unlearning

Multilingual Unlearning in LLMs: Transfer, Dynamics, and Reversibility

2026-06-02 · Chaoyi Xiang, Olga Ohrimenko, Benjamin I. P. Rubinstein, Lea Frermann arxiv

Large language models (LLMs) can memorize sensitive facts, motivating unlearning methods that remove targeted knowledge without costly retraining. However, unlearning research remains heavily English-centric. We study mu…

Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective

2024-07-24 · Yujian Liu, Yang Zhang, Tommi Jaakkola, Shiyu Chang

This paper investigates Who's Harry Potter (WHP), a pioneering yet insufficiently understood method for LLM unlearning. We explore it in two steps. First, we introduce a new task of LLM targeted unlearning, where given a…

A Closer Look at Machine Unlearning for Large Language Models

2024-10-10 · Xiaojian Yuan, Tianyu Pang, Chao Du, Kejiang Chen 외

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove …

DiversityMachine UnlearningSentence

Zero-shot Class Unlearning via Layer-wise Relevance Analysis and Neuronal Path Perturbation

2024-10-31 · Wenhan Chang, Tianqing Zhu, Ping Xiong, Yufeng Wu 외

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models w…

Machine UnlearningPrivacy Preserving