paper-with-me

Papers

ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification

2024-09-20 · Zuomin Qu, Wei Lu, Xiangyang Luo, Qian Wang, Xiaochun Cao

The misuse of deep learning-based facial manipulation poses a potential threat to civil rights. To prevent this fraud at its source, proactive defense technology was proposed to disrupt the manipulation process by adding invisible adversarial perturbations into images, making the forged output unconvincing to the observer. However, their non-directional disruption of the output may result in the retention of identity information of the person in the image, leading to stigmatization of the individual. In this paper, we propose a novel universal framework for combating facial manipulation, called ID-Guard. Specifically, this framework requires only a single forward pass of an encoder-decoder network to generate a cross-model universal adversarial perturbation corresponding to a specific facial image. To ensure anonymity in manipulated facial images, a novel Identity Destruction Module (IDM) is introduced to destroy the identifiable information in forged faces targetedly. Additionally, we optimize the perturbations produced by considering the disruption towards different facial manipulations as a multi-task learning problem and design a dynamic weights strategy to improve cross-model performance. The proposed framework reports impressive results in defending against multiple widely used facial manipulations, effectively distorting the identifiable regions in the manipulated facial images. In addition, our experiments reveal the ID-Guard's ability to enable disrupted images to avoid face inpaintings and open-source image recognition systems.

📄 PDF Abstract BibTeX arXiv:2409.13349

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

Information-containing Adversarial Perturbation for Combating Facial Manipulation Systems

2023-03-21 · Yao Zhu, Yuefeng Chen, Xiaodan Li, Rong Zhang 외

With the development of deep learning technology, the facial manipulation system has become powerful and easy to use. Such systems can modify the attributes of the given facial images, such as hair color, gender, and age…

Fake Image Detection

CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes

2021-05-23 · Hao Huang, Yongtao Wang, Zhaoyu Chen, Yuze Zhang 외

Malicious applications of deepfakes (i.e., technologies generating target facial attributes or entire faces from facial images) have posed a huge threat to individuals' reputation and security. To mitigate these threats,…

Adversarial AttackFace SwappingModel Optimization

Any-Body Guard: Universal Safeguarding for Manipulation Policies via Action Masking

2026-06-21 · Alex Beaudin, Hanna Krasowski, Kartik Nagpal, Sanjit A. Seshia 외 arxiv

Ensuring safety of learning-enabled robotic manipulation across diverse embodiments and tasks still requires significant manual engineering. Existing approaches typically rely on heuristically designed fallback controlle…

Collision Avoidance

GIFGuard: Proactive Forensics against Deepfakes in Facial GIFs via Spatiotemporal Watermarking

2026-04-29 · Shupeng Che, Zhiqing Guo, Changtao Miao, Dan Ma 외 arxiv

The rapid evolution of deepfake technology poses an unprecedented threat to the authenticity of Graphics Interchange Format (GIF) imagery, which serves as a representative of short-loop temporal media in social networks.…

FakeLocator: Robust Localization of GAN-Based Face Manipulations

2020-01-27 · Yihao Huang, Felix Juefei-Xu, Qing Guo, Yang Liu 외

Full face synthesis and partial face manipulation by virtue of the generative adversarial networks (GANs) and its variants have raised wide public concerns. In the multi-media forensics area, detecting and ultimately loc…

Data AugmentationFace GenerationFace SwappingFake Image Detection+1