DepthFake: a depth-based strategy for detecting Deepfake videos
Fake content has grown at an incredible rate over the past few years. The spread of social media and online platforms makes their dissemination on a large scale increasingly accessible by malicious actors. In parallel, due to the growing diffusion of fake image generation methods, many Deep Learning-based detection techniques have been proposed. Most of those methods rely on extracting salient features from RGB images to detect through a binary classifier if the image is fake or real. In this paper, we proposed DepthFake, a study on how to improve classical RGB-based approaches with depth-maps. The depth information is extracted from RGB images with recent monocular depth estimation techniques. Here, we demonstrate the effective contribution of depth-maps to the deepfake detection task on robust pre-trained architectures. The proposed RGBD approach is in fact able to achieve an average improvement of 3.20% and up to 11.7% for some deepfake attacks with respect to standard RGB architectures over the FaceForensic++ dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionDepth EstimationFace SwappingImage GenerationMonocular Depth EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework
Deep learning-based video manipulation methods have become widely accessible to the masses. With little to no effort, people can quickly learn how to generate deepfake (DF) videos. While deep learning-based detection met…
AllDeep LearningFace SwappingUnmasking Deep Fakes: Leveraging Deep Learning for Video Authenticity Detection
Deepfake videos, produced through advanced artificial intelligence methods now a days, pose a new challenge to the truthfulness of the digital media. As Deepfake becomes more convincing day by day, detecting them require…
DeepFake DetectionDeep LearningFace SwappingUnsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistencies
Deepfake videos present an increasing threat to society with potentially negative impact on criminal justice, democracy, and personal safety and privacy. Meanwhile, detecting deepfakes, at scale, remains a very challengi…
DeepFake DetectionFace SwappingA Survey of Deep Fake Detection for Trial Courts
Recently, image manipulation has achieved rapid growth due to the advancement of sophisticated image editing tools. A recent surge of generated fake imagery and videos using neural networks is DeepFake. DeepFake algorith…
Face SwappingImage ManipulationSurveyVideo Transformer for Deepfake Detection with Incremental Learning
Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better…
3D Face ReconstructionDeepFake DetectionFace ReconstructionFace Swapping+1