Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors
Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Some newer methods employ optical flow models to capture this temporal aspect, but they are computationally expensive. In contrast, we propose using the related but often ignored Motion Vectors (MVs) and Information Masks (IMs) from the H.264 video codec, to detect temporal inconsistencies in DeepFakes. Our experiments show that this approach is effective and has minimal computational costs, compared with per-frame RGB-only methods. This could lead to new, real-time temporally-aware DeepFake detection methods for video calls and streaming.
Code (0)
등록된 구현이 없습니다.
Tasks
DeepFake DetectionFace SwappingOptical Flow EstimationSimilar Papers 제목 키워드 기반
Exploiting Style Latent Flows for Generalizing Deepfake Video Detection
This paper presents a new approach for the detection of fake videos, based on the analysis of style latent vectors and their abnormal behavior in temporal changes in the generated videos. We discovered that the generated…
Contrastive LearningDeepFake DetectionFace SwappingDIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection
With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been ex…
DecoderDeepFake DetectionFace SwappingExtending Information Bottleneck Attribution to Video Sequences
We introduce VIBA, a novel approach for explainable video classification by adapting Information Bottlenecks for Attribution (IBA) to video sequences. While most traditional explainability methods are designed for image …
DeepFake DetectionFace SwappingOptical Flow EstimationVideo ClassificationListening Deepfake Detection: A New Perspective Beyond Speaking-Centric Forgery Analysis
Existing deepfake detection research has primarily focused on scenarios where the manipulated subject is actively speaking, i.e., generating fabricated content by altering the speaker's appearance or voice. However, in r…
DeepFake DetectionEMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection
With every advancement in generative AI models, forensics is under increasing pressure. The constant emergence of new generation techniques makes it impossible to collect data for each manipulation to train a deepfake de…
Emotion RecognitionDeepFake Detection