paper-with-me

홈 › Papers

TRACE: Trajectory-Constrained Concept Erasure in Diffusion Models

2025-05-29 · Finn Carter

Text-to-image diffusion models have shown unprecedented generative capability, but their ability to produce undesirable concepts (e.g.~pornographic content, sensitive identities, copyrighted styles) poses serious concerns for privacy, fairness, and safety. {Concept erasure} aims to remove or suppress specific concept information in a generative model. In this paper, we introduce \textbf{TRACE (Trajectory-Constrained Attentional Concept Erasure)}, a novel method to erase targeted concepts from diffusion models while preserving overall generative quality. Our approach combines a rigorous theoretical framework, establishing formal conditions under which a concept can be provably suppressed in the diffusion process, with an effective fine-tuning procedure compatible with both conventional latent diffusion (Stable Diffusion) and emerging rectified flow models (e.g.~FLUX). We first derive a closed-form update to the model's cross-attention layers that removes hidden representations of the target concept. We then introduce a trajectory-aware finetuning objective that steers the denoising process away from the concept only in the late sampling stages, thus maintaining the model's fidelity on unrelated content. Empirically, we evaluate TRACE on multiple benchmarks used in prior concept erasure studies (object classes, celebrity faces, artistic styles, and explicit content from the I2P dataset). TRACE achieves state-of-the-art performance, outperforming recent methods such as ANT, EraseAnything, and MACE in terms of removal efficacy and output quality.

📄 PDF Abstract BibTeX arXiv:2505.23312

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingFairness

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion

2026-08-18 · Qianlong Xiang, Miao Zhang, Kun Wang, Haoyu Zhang 외 arxiv

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for preventing harmful content. Existing adversarial probes evaluate these methods by testing whether …

CRCE: Coreference-Retention Concept Erasure in Text-to-Image Diffusion Models

2025-03-18 · Yuyang Xue, Edward Moroshko, Feng Chen, Jingyu Sun 외

Text-to-Image diffusion models can produce undesirable content that necessitates concept erasure. However, existing methods struggle with under-erasure, leaving residual traces of targeted concepts, or over-erasure, mist…

Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models

2025-09-30 · Daiheng Gao, Nanxiang Jiang, Andi Zhang, Shilin Lu 외 arxiv

Concept erasure techniques have been widely deployed in T2I diffusion models to prevent inappropriate content generation for safety and copyright considerations. However, as models evolve to next-generation architectures…

Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness

2025-09-15 · Zixuan Fu, Yan Ren, Finn Carter, Chenyue Wen 외 arxiv

Diffusion models have achieved unprecedented success in image generation but pose increasing risks in terms of privacy, fairness, and security. A growing demand exists to \emph{erase} sensitive or harmful concepts (e.g.,…

Image Generation

Neighbor-Aware Localized Concept Erasure in Text-to-Image Diffusion Models

2026-03-27 · Zhuan Shi, Alireza Dehghanpour Farashah, Rik de Vries, Golnoosh Farnadi arxiv

Concept erasure in text-to-image diffusion models seeks to remove undesired concepts while preserving overall generative capability. Localized erasure methods aim to restrict edits to the spatial region occupied by the t…