paper-with-me

홈 › Papers

FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes

2022-04-05 · Paarth Neekhara, Shehzeen Hussain, Xinqiao Zhang, Ke Huang, Julian McAuley, Farinaz Koushanfar

Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning classifiers. However, such classifiers do not generalize well to black-box image synthesis techniques and have been shown to be vulnerable to adversarial examples. To address these challenges, we introduce a deep learning based semi-fragile watermarking technique that allows media authentication by verifying an invisible secret message embedded in the image pixels. Instead of identifying and detecting fake media using visual artifacts, we propose to proactively embed a semi-fragile watermark into a real image so that we can prove its authenticity when needed. Our watermarking framework is designed to be fragile to facial manipulations or tampering while being robust to benign image-processing operations such as image compression, scaling, saturation, contrast adjustments etc. This allows images shared over the internet to retain the verifiable watermark as long as face-swapping or any other Deepfake modification technique is not applied. We demonstrate that FaceSigns can embed a 128 bit secret as an imperceptible image watermark that can be recovered with a high bit recovery accuracy at several compression levels, while being non-recoverable when unseen Deepfake manipulations are applied. For a set of unseen benign and Deepfake manipulations studied in our work, FaceSigns can reliably detect manipulated content with an AUC score of 0.996 which is significantly higher than prior image watermarking and steganography techniques.

📄 PDF Abstract BibTeX arXiv:2204.01960

Code (1)

paarthneekhara/facesignsdemo 공식 구현 pytorch

Tasks

Face SwappingImage CompressionImage Generation

Similar Papers 제목 키워드 기반

Image content dependent semi-fragile watermarking with localized tamper detection

2021-06-27 · Samira Hosseini, Mojtaba Mahdavi

Content-independent watermarks and block-wise independency can be considered as vulnerabilities in semi-fragile watermarking methods. In this paper to achieve the objectives of semi-fragile watermarking techniques, a met…

Social Media Authentication and Combating Deepfakes using Semi-fragile Invisible Image Watermarking

2024-10-02 · Aakash Varma Nadimpalli, Ajita Rattani

With the significant advances in deep generative models for image and video synthesis, Deepfakes and manipulated media have raised severe societal concerns. Conventional machine learning classifiers for deepfake detectio…

DeepFake DetectionFace Swapping

FractalForensics: Proactive Deepfake Detection and Localization via Fractal Watermarks

2025-04-13 · Tianyi Wang, Harry Cheng, Ming-Hui Liu, Mohan Kankanhalli

Proactive Deepfake detection via robust watermarks has been raised ever since passive Deepfake detectors encountered challenges in identifying high-quality synthetic images. However, while demonstrating reasonable detect…

DeepFake DetectionFace Swapping

A Survey of Fragile Model Watermarking

2024-06-07 · Zhenzhe Gao, Yu Cheng, Zhaoxia Yin

Model fragile watermarking, inspired by both the field of adversarial attacks on neural networks and traditional multimedia fragile watermarking, has gradually emerged as a potent tool for detecting tampering, and has wi…

Autonomous DrivingmodelSurvey

A Watermarking Technique Using Discrete Curvelet Transform for Security of Multiple Biometric Features

2017-01-16 · Rohit M. Thanki, Ved Vyas Dwivedi, Komal R. Borisagar

The robustness and security of the biometric watermarking approach can be improved by using a multiple watermarking. This multiple watermarking proposed for improving security of biometric features and data. When the imp…

Edge Detection