DeepFake Detection Based on the Discrepancy Between the Face and its Context
We propose a method for detecting face swapping and other identity manipulations in single images. Face swapping methods, such as DeepFake, manipulate the face region, aiming to adjust the face to the appearance of its context, while leaving the context unchanged. We show that this modus operandi produces discrepancies between the two regions. These discrepancies offer exploitable telltale signs of manipulation. Our approach involves two networks: (i) a face identification network that considers the face region bounded by a tight semantic segmentation, and (ii) a context recognition network that considers the face context (e.g., hair, ears, neck). We describe a method which uses the recognition signals from our two networks to detect such discrepancies, providing a complementary detection signal that improves conventional real vs. fake classifiers commonly used for detecting fake images. Our method achieves state of the art results on the FaceForensics++, Celeb-DF-v2, and DFDC benchmarks for face manipulation detection, and even generalizes to detect fakes produced by unseen methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionFace IdentificationFace SwappingSemantic SegmentationSimilar Papers 제목 키워드 기반
KoDF: A Large-scale Korean DeepFake Detection Dataset
A variety of effective face-swap and face-reenactment methods have been publicized in recent years, democratizing the face synthesis technology to a great extent. Videos generated as such have come to be called deepfakes…
Adversarial AttackDeepFake DetectionFace GenerationFace Reenactment+1Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection
Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, whic…
DeepFake DetectionFace SwappingReal Face Foundation Representation Learning for Generalized Deepfake Detection
The emergence of deepfake technologies has become a matter of social concern as they pose threats to individual privacy and public security. It is now of great significance to develop reliable deepfake detectors. However…
DeepFake DetectionFace SwappingRepresentation LearningSGF-CDNet: A Consistency-Discrepancy Graph Network over Semantic-Geometric Fused Nodes for Face Forgery Detection
The rapid advancement of deepfakes necessitates robust face forgery detection. Although forged faces may lack obvious artifacts, they often contain subtle disharmony among different facial regions. We propose SGF-CDNet, …
Relational ReasoningFace ParsingDeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis
Applications of deep learning to synthetic media generation allow the creation of convincing forgeries, called DeepFakes, with limited technical expertise. DeepFake detection is an increasingly active research area. In t…
DeepFake DetectionFace SwappingFacial Landmark DetectionHead Pose Estimation+1