DiffFake: Exposing Deepfakes using Differential Anomaly Detection
Traditional deepfake detectors have dealt with the detection problem as a binary classification task. This approach can achieve satisfactory results in cases where samples of a given deepfake generation technique have been seen during training, but can easily fail with deepfakes generated by other techniques. In this paper, we propose DiffFake, a novel deepfake detector that approaches the detection problem as an anomaly detection task. Specifically, DiffFake learns natural changes that occur between two facial images of the same person by leveraging a differential anomaly detection framework. This is done by combining pairs of deep face embeddings and using them to train an anomaly detection model. We further propose to train a feature extractor on pseudo-deepfakes with global and local artifacts, to extract meaningful and generalizable features that can then be used to train the anomaly detection model. We perform extensive experiments on five different deepfake datasets and show that our method can match and sometimes even exceed the performance of state-of-the-art competitors.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionBinary ClassificationFace SwappingSimilar Papers 제목 키워드 기반
Anomaly Detection and Localization for Speech Deepfakes via Feature Pyramid Matching
The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing meth…
Anomaly DetectionDeepFake DetectionFace SwappingExposing Lip-syncing Deepfakes from Mouth Inconsistencies
A lip-syncing deepfake is a digitally manipulated video in which a person's lip movements are created convincingly using AI models to match altered or entirely new audio. Lip-syncing deepfakes are a dangerous type of dee…
DeepFake DetectionFace SwappingDeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
As the GAN-based face image and video generation techniques, widely known as DeepFakes, have become more and more matured and realistic, there comes a pressing and urgent demand for effective DeepFakes detectors. Motivat…
DeepFake DetectionFace SwappingPhotoplethysmography (PPG)Video GenerationAn Outlier Exposure Approach to Improve Visual Anomaly Detection Performance for Mobile Robots
We consider the problem of building visual anomaly detection systems for mobile robots. Standard anomaly detection models are trained using large datasets composed only of non-anomalous data. However, in robotics applica…
Anomaly DetectionCAD 100K: A Comprehensive Multi-Task Dataset for Car Related Visual Anomaly Detection
Multi-task visual anomaly detection is critical for car-related manufacturing quality assessment. However, existing methods remain task-specific, hindered by the absence of a unified benchmark for multi-task evaluation. …
Multi-Task LearningData AugmentationAnomaly Detection