paper-with-me

Papers

Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient

2024-05-24 · Yongliang Wu, Shiji Zhou, Mingzhuo Yang, Lianzhe Wang, Heng Chang, Wenbo Zhu, Xinting Hu, Xiao Zhou, Xu Yang

Text-to-image diffusion models have achieved remarkable success in generating photorealistic images. However, the inclusion of sensitive information during pre-training poses significant risks. Machine Unlearning (MU) offers a promising solution to eliminate sensitive concepts from these models. Despite its potential, existing MU methods face two main challenges: 1) limited generalization, where concept erasure is effective only within the unlearned set, failing to prevent sensitive concept generation from out-of-set prompts; and 2) utility degradation, where removing target concepts significantly impacts the model's overall performance. To address these issues, we propose a novel concept domain correction framework named \textbf{DoCo} (\textbf{Do}main \textbf{Co}rrection). By aligning the output domains of sensitive and anchor concepts through adversarial training, our approach ensures comprehensive unlearning of target concepts. Additionally, we introduce a concept-preserving gradient surgery technique that mitigates conflicting gradient components, thereby preserving the model's utility while unlearning specific concepts. Extensive experiments across various instances, styles, and offensive concepts demonstrate the effectiveness of our method in unlearning targeted concepts with minimal impact on related concepts, outperforming previous approaches even for out-of-distribution prompts.

📄 PDF Abstract BibTeX arXiv:2405.15304

Code (2)

yongliang-wu/doco 공식 구현 pytorch
yongliang-wu/unlearn-DoCoPreG 공식 구현 pytorch

Tasks

Image GenerationMachine Unlearning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Projected Gradient Unlearning for Text-to-Image Diffusion Models: Defending Against Concept Revival Attacks

2026-04-22 · Aljalila Aladawi, Mohammed Talha Alam, Fakhri Karray arxiv

Machine unlearning for text-to-image diffusion models aims to selectively remove undesirable concepts from pre-trained models without costly retraining. Current unlearning methods share a common weakness: erased concepts…

Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts

2024-10-16 · Hongcheng Gao, Tianyu Pang, Chao Du, Taihang Hu 외

With the rapid progress of diffusion-based content generation, significant efforts are being made to unlearn harmful or copyrighted concepts from pretrained diffusion models (DMs) to prevent potential model misuse. Howev…

Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge

2025-07-09 · Eric Yeats, Darryl Hannan, Henry Kvinge, Timothy Doster 외 arxiv

Machine unlearning (MU) is a promising cost-effective method to cleanse undesired information (generated concepts, biases, or patterns) from foundational diffusion models. While MU is orders of magnitude less costly than…

Unlearning Concepts from Text-to-Video Diffusion Models

2024-07-19 · Shiqi Liu, Yihua Tan

With the advancement of computer vision and natural language processing, text-to-video generation, enabled by text-to-video diffusion models, has become more prevalent. These models are trained using a large amount of da…

Text-to-Video GenerationVideo Generation

Roots Beneath the Cut: Uncovering the Risk of Concept Revival in Pruning-Based Unlearning for Diffusion Models

2026-02-28 · Ci Zhang, Zhaojun Ding, Chence Yang, Jun Liu 외 arxiv

Pruning-based unlearning has recently emerged as a fast, training-free, and data-independent approach to remove undesired concepts from diffusion models. It promises high efficiency and robustness, offering an attractive…