paper-with-me

Papers

Optimization-Free Image Immunization Against Diffusion-Based Editing

2024-11-27 · Tarik Can Ozden, Ozgur Kara, Oguzhan Akcin, Kerem Zaman, Shashank Srivastava, Sandeep P. Chinchali, James M. Rehg

Current image immunization defense techniques against diffusion-based editing embed imperceptible noise in target images to disrupt editing models. However, these methods face scalability challenges, as they require time-consuming re-optimization for each image-taking hours for small batches. To address these challenges, we introduce DiffVax, a scalable, lightweight, and optimization-free framework for image immunization, specifically designed to prevent diffusion-based editing. Our approach enables effective generalization to unseen content, reducing computational costs and cutting immunization time from days to milliseconds-achieving a 250,000x speedup. This is achieved through a loss term that ensures the failure of editing attempts and the imperceptibility of the perturbations. Extensive qualitative and quantitative results demonstrate that our model is scalable, optimization-free, adaptable to various diffusion-based editing tools, robust against counter-attacks, and, for the first time, effectively protects video content from editing. Our code is provided in our project webpage.

📄 PDF Abstract BibTeX arXiv:2411.17957

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Universal Image Immunization against Diffusion-based Image Editing via Semantic Injection

2026-02-16 · Chanhui Lee, Donggyu Choi, Seunghyun Shin, Hae-Gon Jeon 외 arxiv

Diffusion model advances have enabled powerful text-guided image editing, but also raise ethical and legal risks such as deepfakes and unauthorized use. To prevent these risks, adversarial attack-based image immunization…

Adversarial AttackImage Editing

Distraction is All You Need: Memory-Efficient Image Immunization against Diffusion-Based Image Editing

2024-01-01 · CVPR 2024 1 · Ling Lo, Cheng Yu Yeo, Hong-Han Shuai, Wen-Huang Cheng

Recent text-to-image (T2I) diffusion models have revolutionized image editing by empowering users to control outcomes using natural language. However the ease of image manipulation has raised ethical concerns with th…

AllDenoisingGPUImage Inpainting+1

Semantic Mismatch and Perceptual Degradation: A New Perspective on Image Editing Immunity

2025-12-16 · Shuai Dong, Jie Zhang, Guoying Zhao, Shiguang Shan 외 arxiv

Text-guided image editing via diffusion models, while powerful, raises significant concerns about misuse, motivating efforts to immunize images against unauthorized edits using imperceptible perturbations. Prevailing met…

Image Editing

GIFT: Gradient-aware Immunization of diffusion models against malicious Fine-Tuning with safe concepts retention

2025-07-18 · Amro Abdalla, Ismail Shaheen, Dan DeGenaro, Rupayan Mallick 외 arxiv

We present GIFT: a {G}radient-aware {I}mmunization technique to defend diffusion models against malicious {F}ine-{T}uning while preserving their ability to generate safe content. Existing safety mechanisms like safety ch…

Graph Adversarial Immunization for Certifiable Robustness

2023-02-16 · Shuchang Tao, HuaWei Shen, Qi Cao, Yunfan Wu 외

Despite achieving great success, graph neural networks (GNNs) are vulnerable to adversarial attacks. Existing defenses focus on developing adversarial training or model modification. In this paper, we propose and formula…

Adversarial AttackCombinatorial Optimization