paper-with-me

홈 › Papers

TraSCE: Trajectory Steering for Concept Erasure

2024-12-10 · Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir Memon, Julian Togelius, Yuki Mitsufuji

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as not-safe-for-work (NSFW) images. While approaches have been proposed to erase such abstract concepts from the models, jail-breaking techniques have succeeded in bypassing such safety measures. In this paper, we propose TraSCE, an approach to guide the diffusion trajectory away from generating harmful content. Our approach is based on negative prompting, but as we show in this paper, conventional negative prompting is not a complete solution and can easily be bypassed in some corner cases. To address this issue, we first propose a modification of conventional negative prompting. Furthermore, we introduce a localized loss-based guidance that enhances the modified negative prompting technique by steering the diffusion trajectory. We demonstrate that our proposed method achieves state-of-the-art results on various benchmarks in removing harmful content including ones proposed by red teams; and erasing artistic styles and objects. Our proposed approach does not require any training, weight modifications, or training data (both image or prompt), making it easier for model owners to erase new concepts.

📄 PDF Abstract BibTeX arXiv:2412.07658

Code (1)

anubhav1997/trasce 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models

2025-09-30 · Daiheng Gao, Nanxiang Jiang, Andi Zhang, Shilin Lu 외 arxiv

Concept erasure techniques have been widely deployed in T2I diffusion models to prevent inappropriate content generation for safety and copyright considerations. However, as models evolve to next-generation architectures…

Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Concepts

2025-04-17 · Leyang Li, Shilin Lu, Yan Ren, Adams Wai-Kin Kong

Ensuring the ethical deployment of text-to-image models requires effective techniques to prevent the generation of harmful or inappropriate content. While concept erasure methods offer a promising solution, existing fine…

Denoising

Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformers

2026-08-13 · Qiao Li, Xiaomeng Fu, Yuanshu Zhao, Qipeng Wang 외 arxiv

Multimodal Diffusion Transformers (MM-DiTs) have demonstrated remarkable text-to-image generation performance, surpassing traditional U-Net-based diffusion models. Nevertheless, their powerful generative capabilities als…

Text-to-Image Generation

MidSteer: Optimal Affine Framework for Steering Generative Models

2026-04-17 · Tatiana Gaintseva, Andrew Stepanov, Ziquan Liu, Martin Benning 외 arxiv

Steering intermediate representations has emerged as a powerful strategy for controlling generative models, particularly in post-deployment alignment and safety settings. However, despite its empirical success, it curren…

TRACE: Trajectory-Constrained Concept Erasure in Diffusion Models

2025-05-29 · Finn Carter

Text-to-image diffusion models have shown unprecedented generative capability, but their ability to produce undesirable concepts (e.g.~pornographic content, sensitive identities, copyrighted styles) poses serious concern…

DenoisingFairness