paper-with-me

홈 › Papers

Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation

2024-10-21 · Anh Bui, Long Vuong, Khanh Doan, Trung Le, Paul Montague, Tamas Abraham, Dinh Phung

Diffusion models excel at generating visually striking content from text but can inadvertently produce undesirable or harmful content when trained on unfiltered internet data. A practical solution is to selectively removing target concepts from the model, but this may impact the remaining concepts. Prior approaches have tried to balance this by introducing a loss term to preserve neutral content or a regularization term to minimize changes in the model parameters, yet resolving this trade-off remains challenging. In this work, we propose to identify and preserving concepts most affected by parameter changes, termed as \textit{adversarial concepts}. This approach ensures stable erasure with minimal impact on the other concepts. We demonstrate the effectiveness of our method using the Stable Diffusion model, showing that it outperforms state-of-the-art erasure methods in eliminating unwanted content while maintaining the integrity of other unrelated elements. Our code is available at \url{https://github.com/tuananhbui89/Erasing-Adversarial-Preservation}.

📄 PDF Abstract BibTeX arXiv:2410.15618

Code (2)

tuananhbui89/erasing-adversarial-preservation 공식 구현 pytorch
tuananhbui89/adaptive-guided-erasure pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Pruning for Robust Concept Erasing in Diffusion Models

2024-05-26 · Tianyun Yang, Juan Cao, Chang Xu

Despite the impressive capabilities of generating images, text-to-image diffusion models are susceptible to producing undesirable outputs such as NSFW content and copyrighted artworks. To address this issue, recent studi…

Sensitivity

T2VUnlearning: A Concept Erasing Method for Text-to-Video Diffusion Models

2025-05-23 · Xiaoyu Ye, Songjie Cheng, Yongtao Wang, Yajiao Xiong 외

Recent advances in text-to-video (T2V) diffusion models have significantly enhanced the quality of generated videos. However, their ability to produce explicit or harmful content raises concerns about misuse and potentia…

SAGE: Exploring the Boundaries of Unsafe Concept Domain with Semantic-Augment Erasing

2025-06-11 · Hongguang Zhu, Yunchao Wei, Mengyu Wang, Siyu Jiao 외

Diffusion models (DMs) have achieved significant progress in text-to-image generation. However, the inevitable inclusion of sensitive information during pre-training poses safety risks, such as unsafe content generation …

Image GenerationText to Image GenerationText-to-Image Generation

Removing Undesirable Concepts in Text-to-Image Diffusion Models with Learnable Prompts

2024-03-18 · Anh Bui, Khanh Doan, Trung Le, Paul Montague 외

Diffusion models have shown remarkable capability in generating visually impressive content from textual descriptions. However, these models are trained on vast internet data, much of which contains undesirable elements …

Transfer Learning

Fantastic Targets for Concept Erasure in Diffusion Models and Where To Find Them

2025-01-31 · Anh Bui, Trang Vu, Long Vuong, Trung Le 외

Concept erasure has emerged as a promising technique for mitigating the risk of harmful content generation in diffusion models by selectively unlearning undesirable concepts. The common principle of previous works to rem…