paper-with-me

Papers

On the Detection of Digital Face Manipulation

2019-10-03 · CVPR 2020 6 · Hao Dang, Feng Liu, Joel Stehouwer, Xiaoming Liu, Anil Jain

Detecting manipulated facial images and videos is an increasingly important topic in digital media forensics. As advanced face synthesis and manipulation methods are made available, new types of fake face representations are being created which have raised significant concerns for their use in social media. Hence, it is crucial to detect manipulated face images and localize manipulated regions. Instead of simply using multi-task learning to simultaneously detect manipulated images and predict the manipulated mask (regions), we propose to utilize an attention mechanism to process and improve the feature maps for the classification task. The learned attention maps highlight the informative regions to further improve the binary classification (genuine face v. fake face), and also visualize the manipulated regions. To enable our study of manipulated face detection and localization, we collect a large-scale database that contains numerous types of facial forgeries. With this dataset, we perform a thorough analysis of data-driven fake face detection. We show that the use of an attention mechanism improves facial forgery detection and manipulated region localization.

📄 PDF Abstract BibTeX arXiv:1910.01717

Code (1)

JStehouwer/FFD_CVPR2020 공식 구현 pytorch

Tasks

Binary ClassificationFace DetectionFace GenerationGeneral ClassificationMulti-Task Learning

Similar Papers 제목 키워드 기반

Crowd-powered Face Manipulation Detection: Fusing Human Examiner Decisions

2022-01-31 · Christian Rathgeb, Robert Nichols, Mathias Ibsen, Pawel Drozdowski 외

We investigate the potential of fusing human examiner decisions for the task of digital face manipulation detection. To this end, various decision fusion methods are proposed incorporating the examiners' decision confide…

Face SwappingImage ManipulationImage Manipulation Detection

Generalized Deepfakes Detection with Reconstructed-Blended Images and Multi-scale Feature Reconstruction Network

2023-12-13 · Yuyang Sun, Huy H. Nguyen, Chun-Shien Lu, Zhiyong Zhang 외

The growing diversity of digital face manipulation techniques has led to an urgent need for a universal and robust detection technology to mitigate the risks posed by malicious forgeries. We present a blended-based detec…

DiversityFace Swapping

Effects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching

2021-03-05 · Christian Rathgeb, Kevin Bernardo, Nathania E. Haryanto, Christoph Busch

In the past years, numerous methods have been introduced to reliably detect digital face image manipulations. Lately, the generalizability of these schemes has been questioned in particular with respect to image post-pro…

Image CompressionImage ManipulationImage Manipulation Detection

Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

2022-01-28 · Robert Nichols, Christian Rathgeb, Pawel Drozdowski, Christoph Busch

In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition sy…

Face RecognitionFace Swapping

FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction

2023-07-08 · Ganglai Wang, Peng Zhang, Junwen Xiong, Feihan Yang 외

DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake video detection is further improved. By on…

Face DetectionFace GenerationFace SwappingOptical Flow Estimation+1