Practical Manipulation Model for Robust Deepfake Detection
Modern deepfake detection models have achieved strong performance even on the challenging cross-dataset task. However, detection performance under non-ideal conditions remains very unstable, limiting success on some benchmark datasets and making it easy to circumvent detection. Inspired by the move to a more real-world degradation model in the area of image super-resolution, we have developed a Practical Manipulation Model (PMM) that covers a larger set of possible forgeries. We extend the space of pseudo-fakes by using Poisson blending, more diverse masks, generator artifacts, and distractors. Additionally, we improve the detectors' generality and robustness by adding strong degradations to the training images. We demonstrate that these changes not only significantly enhance the model's robustness to common image degradations but also improve performance on standard benchmark datasets. Specifically, we show clear increases of $3.51\%$ and $6.21\%$ AUC on the DFDC and DFDCP datasets, respectively, over the s-o-t-a LAA backbone. Furthermore, we highlight the lack of robustness in previous detectors and our improvements in this regard. Code can be found at https://github.com/BenediktHopf/PMM
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionFace SwappingImage Super-ResolutionmodelSuper-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Robust Sequential DeepFake Detection
Since photorealistic faces can be readily generated by facial manipulation technologies nowadays, potential malicious abuse of these technologies has drawn great concerns. Numerous deepfake detection methods are thus pro…
DeepFake DetectionFace SwappingFacial EditingDetecting and Recovering Sequential DeepFake Manipulation
Since photorealistic faces can be readily generated by facial manipulation technologies nowadays, potential malicious abuse of these technologies has drawn great concerns. Numerous deepfake detection methods are thus pro…
DeepFake DetectionFace SwappingFacial EditingImage CaptioningDDL: A Dataset for Interpretable Deepfake Detection and Localization in Real-World Scenarios
Recent advances in AIGC have exacerbated the misuse of malicious deepfake content, making the development of reliable deepfake detection methods an essential means to address this challenge. Although existing deepfake de…
Binary ClassificationDeepFake DetectionFace SwappingDeiTFake: Deepfake Detection Model using DeiT Multi-Stage Training
Deepfakes are major threats to the integrity of digital media. We propose DeiTFake, a DeiT-based transformer and a novel two-stage progressive training strategy with increasing augmentation complexity. The approach appli…
Knowledge DistillationDeepFake DetectionCLAD: Robust Audio Deepfake Detection Against Manipulation Attacks with Contrastive Learning
The increasing prevalence of audio deepfakes poses significant security threats, necessitating robust detection methods. While existing detection systems exhibit promise, their robustness against malicious audio manipula…
Audio Deepfake DetectionContrastive LearningDeepFake DetectionFace Swapping