paper-with-me

홈 › Papers

Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection

2025-04-30 · Liqin Wang, Qianyue Hu, Wei Lu, Xiangyang Luo

The success of face recognition (FR) systems has led to serious privacy concerns due to potential unauthorized surveillance and user tracking on social networks. Existing methods for enhancing privacy fail to generate natural face images that can protect facial privacy. In this paper, we propose diffusion-based adversarial identity manipulation (DiffAIM) to generate natural and highly transferable adversarial faces against malicious FR systems. To be specific, we manipulate facial identity within the low-dimensional latent space of a diffusion model. This involves iteratively injecting gradient-based adversarial identity guidance during the reverse diffusion process, progressively steering the generation toward the desired adversarial faces. The guidance is optimized for identity convergence towards a target while promoting semantic divergence from the source, facilitating effective impersonation while maintaining visual naturalness. We further incorporate structure-preserving regularization to preserve facial structure consistency during manipulation. Extensive experiments on both face verification and identification tasks demonstrate that compared with the state-of-the-art, DiffAIM achieves stronger black-box attack transferability while maintaining superior visual quality. We also demonstrate the effectiveness of the proposed approach for commercial FR APIs, including Face++ and Aliyun.

📄 PDF Abstract BibTeX arXiv:2504.21646

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionFace Verification

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Information-containing Adversarial Perturbation for Combating Facial Manipulation Systems

2023-03-21 · Yao Zhu, Yuefeng Chen, Xiaodan Li, Rong Zhang 외

With the development of deep learning technology, the facial manipulation system has become powerful and easy to use. Such systems can modify the attributes of the given facial images, such as hair color, gender, and age…

Fake Image Detection

Diffusion-Driven Deceptive Patches: Adversarial Manipulation and Forensic Detection in Facial Identity Verification

2026-01-14 · Shahrzad Sayyafzadeh, Hongmei Chi, Shonda Bernadin arxiv

This work presents an end-to-end pipeline for generating, refining, and evaluating adversarial patches to compromise facial biometric systems, with applications in forensic analysis and security testing. We utilize FGSM …

Enhancing Facial Privacy Protection via Weakening Diffusion Purification

2025-03-13 · CVPR 2025 1 · Ali Salar, Qing Liu, YingLi Tian, Guoying Zhao

The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance…

Face Recognition

Hierarchical Anti-Aesthetics: Protecting Facial Privacy against Customized Diffusion Models

2026-07-02 · Songping Wang, Yueming Lyu, Shiqi Liu, Chen Zhao 외 arxiv

The rise of customized diffusion models has fueled a boom in personalized visual content creation, but it also introduces serious risks of malicious misuse, thereby posing threats to personal privacy. Image aesthetics ar…

Flux-Guard: Facial Identity Protection using diffusion models

2026-06-16 · Jie Wang, Tao Wang, Ru Zhang, Jianyi Liu arxiv

The widespread deployment of face recognition (FR) systems exposes personal images shared on social media and public platforms to identity linkage and privacy risks. Existing adversarial privacy protection methods can de…

Face Recognition