On the Detection of Digital Face Manipulation
Detecting manipulated facial images and videos is an increasingly important topic in digital media forensics. As advanced face synthesis and manipulation methods are made available, new types of fake face representations are being created which have raised significant concerns for their use in social media. Hence, it is crucial to detect manipulated face images and localize manipulated regions. Instead of simply using multi-task learning to simultaneously detect manipulated images and predict the manipulated mask (regions), we propose to utilize an attention mechanism to process and improve the feature maps for the classification task. The learned attention maps highlight the informative regions to further improve the binary classification (genuine face v. fake face), and also visualize the manipulated regions. To enable our study of manipulated face detection and localization, we collect a large-scale database that contains numerous types of facial forgeries. With this dataset, we perform a thorough analysis of data-driven fake face detection. We show that the use of an attention mechanism improves facial forgery detection and manipulated region localization.
Code (1)
Tasks
Binary ClassificationFace DetectionFace GenerationGeneral ClassificationMulti-Task LearningSimilar Papers 제목 키워드 기반
Crowd-powered Face Manipulation Detection: Fusing Human Examiner Decisions
We investigate the potential of fusing human examiner decisions for the task of digital face manipulation detection. To this end, various decision fusion methods are proposed incorporating the examiners' decision confide…
Face SwappingImage ManipulationImage Manipulation DetectionGeneralized Deepfakes Detection with Reconstructed-Blended Images and Multi-scale Feature Reconstruction Network
The growing diversity of digital face manipulation techniques has led to an urgent need for a universal and robust detection technology to mitigate the risks posed by malicious forgeries. We present a blended-based detec…
DiversityFace SwappingEffects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching
In the past years, numerous methods have been introduced to reliably detect digital face image manipulations. Lately, the generalizability of these schemes has been questioned in particular with respect to image post-pro…
Image CompressionImage ManipulationImage Manipulation DetectionPsychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations
In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition sy…
Face RecognitionFace SwappingFTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction
DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake video detection is further improved. By on…
Face DetectionFace GenerationFace SwappingOptical Flow Estimation+1