Diff-Privacy: Diffusion-based Face Privacy Protection
Privacy protection has become a top priority as the proliferation of AI techniques has led to widespread collection and misuse of personal data. Anonymization and visual identity information hiding are two important facial privacy protection tasks that aim to remove identification characteristics from facial images at the human perception level. However, they have a significant difference in that the former aims to prevent the machine from recognizing correctly, while the latter needs to ensure the accuracy of machine recognition. Therefore, it is difficult to train a model to complete these two tasks simultaneously. In this paper, we unify the task of anonymization and visual identity information hiding and propose a novel face privacy protection method based on diffusion models, dubbed Diff-Privacy. Specifically, we train our proposed multi-scale image inversion module (MSI) to obtain a set of SDM format conditional embeddings of the original image. Based on the conditional embeddings, we design corresponding embedding scheduling strategies and construct different energy functions during the denoising process to achieve anonymization and visual identity information hiding. Extensive experiments have been conducted to validate the effectiveness of our proposed framework in protecting facial privacy.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingSchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Facial Privacy Protection via Weakening Diffusion Purification
The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance…
Face RecognitionPAC Privacy Preserving Diffusion Models
Data privacy protection is garnering increased attention among researchers. Diffusion models (DMs), particularly with strict differential privacy, can potentially produce images with both high privacy and visual quality.…
Privacy PreservingSlerpFace: Face Template Protection via Spherical Linear Interpolation
Contemporary face recognition systems use feature templates extracted from face images to identify persons. To enhance privacy, face template protection techniques are widely employed to conceal sensitive identity and ap…
Face RecognitionEnhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning
In the realm of multimedia data analysis, the extensive use of image datasets has escalated concerns over privacy protection within such data. Current research predominantly focuses on privacy protection either in data s…
AttributeMachine UnlearningTowards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Framework
Denoising diffusion models have shown remarkable potential in various generation tasks. The open-source large-scale text-to-image model, Stable Diffusion, becomes prevalent as it can generate realistic artistic or facial…
Denoising