paper-with-me

홈 › Papers

ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning

2024-05-29 · Ruchika Chavhan, Da Li, Timothy Hospedales

While large-scale text-to-image diffusion models have demonstrated impressive image-generation capabilities, there are significant concerns about their potential misuse for generating unsafe content, violating copyright, and perpetuating societal biases. Recently, the text-to-image generation community has begun addressing these concerns by editing or unlearning undesired concepts from pre-trained models. However, these methods often involve data-intensive and inefficient fine-tuning or utilize various forms of token remapping, rendering them susceptible to adversarial jailbreaks. In this paper, we present a simple and effective training-free approach, ConceptPrune, wherein we first identify critical regions within pre-trained models responsible for generating undesirable concepts, thereby facilitating straightforward concept unlearning via weight pruning. Experiments across a range of concepts including artistic styles, nudity, object erasure, and gender debiasing demonstrate that target concepts can be efficiently erased by pruning a tiny fraction, approximately 0.12% of total weights, enabling multi-concept erasure and robustness against various white-box and black-box adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2405.19237

Code (2)

ruchikachavhan/concept-prune 공식 구현 pytorch
linweiii/backdoordm pytorch

Tasks

Image GenerationText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Orthogonal Concept Erasure for Diffusion Models

2026-05-27 · Yuhao Sun, Lingyun Yu, Haoxiang Xu, Fengyuan Miao 외 arxiv

Concept erasure has emerged as a promising approach to mitigate undesired or unsafe content in diffusion models, yet existing methods still face significant limitations. While training-based methods are effective, their …

Large Language Models Relearn Removed Concepts

2024-01-03 · Michelle Lo, Shay B. Cohen, Fazl Barez

Advances in model editing through neuron pruning hold promise for removing undesirable concepts from large language models. However, it remains unclear whether models have the capacity to reacquire pruned concepts after …

Model Editing

Editing Massive Concepts in Text-to-Image Diffusion Models

2024-03-20 · Tianwei Xiong, Enze Xie, Yue Wu, Zhenguo Li 외

Text-to-image diffusion models suffer from the risk of generating outdated, copyrighted, incorrect, and biased content. While previous methods have mitigated the issues on a small scale, it is essential to handle them si…

Model Editing

Concept Lancet: Image Editing with Compositional Representation Transplant

2025-04-03 · CVPR 2025 1 · Jinqi Luo, Tianjiao Ding, Kwan Ho Ryan Chan, Hancheng Min 외

Diffusion models are widely used for image editing tasks. Existing editing methods often design a representation manipulation procedure by curating an edit direction in the text embedding or score space. However, such a …

3DiFACE: Synthesizing and Editing Holistic 3D Facial Animation

2025-09-30 · Balamurugan Thambiraja, Malte Prinzler, Sadegh Aliakbarian, Darren Cosker 외 arxiv

Creating personalized 3D animations with precise control and realistic head motions remains challenging for current speech-driven 3D facial animation methods. Editing these animations is especially complex and time consu…