Exploring the Impact of Moire Pattern on Deepfake Detectors
Deepfake detection is critical in mitigating the societal threats posed by manipulated videos. While various algorithms have been developed for this purpose, challenges arise when detectors operate externally, such as on smartphones, when users take a photo of deepfake images and upload on the Internet. One significant challenge in such scenarios is the presence of Moir\'e patterns, which degrade image quality and confound conventional classification algorithms, including deep neural networks (DNNs). The impact of Moir\'e patterns remains largely unexplored for deepfake detectors. In this study, we investigate how camera-captured deepfake videos from digital screens affect detector performance. We conducted experiments using two prominent datasets, CelebDF and FF++, comparing the performance of four state-of-the-art detectors on camera-captured deepfake videos with introduced Moir\'e patterns. Our findings reveal a significant decline in detector accuracy, with none achieving above 68% on average. This underscores the critical need to address Moir\'e pattern challenges in real-world deepfake detection scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionFace SwappingSimilar Papers 제목 키워드 기반
Exploring Strengths and Weaknesses of Super-Resolution Attack in Deepfake Detection
Image manipulation is rapidly evolving, allowing the creation of credible content that can be used to bend reality. Although the results of deepfake detectors are promising, deepfakes can be made even more complicated to…
DeepFake DetectionFace SwappingImage ManipulationSuper-ResolutionImpact of Benign Modifications on Discriminative Performance of Deepfake Detectors
Deepfakes are becoming increasingly popular in both good faith applications such as in entertainment and maliciously intended manipulations such as in image and video forgery. Primarily motivated by the latter, a large n…
DeepFake DetectionDenoisingFace SwappingMoire Image Restoration using Multi Level Hyper Vision Net
A moire pattern in the images is resulting from high frequency patterns captured by the image sensor (colour filter array) that appear after demosaicing. These Moire patterns would appear in natural images of scenes with…
DemosaickingImage RestorationSSIMDeepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection
Deepfake detectors are typically trained on large sets of pristine and generated images, resulting in limited generalization capacity; they excel at identifying deepfakes created through methods encountered during traini…
DeepFake DetectionFace SwappingImage GenerationVideo Demoireing using Focused-Defocused Dual-Camera System
Moire patterns, unwanted color artifacts in images and videos, arise from the interference between spatially high-frequency scene contents and the spatial discrete sampling of digital cameras. Existing demoireing methods…