FOCAL: A Forgery Localization Framework based on Video Coding Self-Consistency
Forgery operations on video contents are nowadays within the reach of anyone, thanks to the availability of powerful and user-friendly editing software. Integrity verification and authentication of videos represent a major interest in both journalism (e.g., fake news debunking) and legal environments dealing with digital evidence (e.g., a court of law). While several strategies and different forensics traces have been proposed in recent years, latest solutions aim at increasing the accuracy by combining multiple detectors and features. This paper presents a video forgery localization framework that verifies the self-consistency of coding traces between and within video frames, by fusing the information derived from a set of independent feature descriptors. The feature extraction step is carried out by means of an explainable convolutional neural network architecture, specifically designed to look for and classify coding artifacts. The overall framework was validated in two typical forgery scenarios: temporal and spatial splicing. Experimental results show an improvement to the state-of-the-art on temporal splicing localization and also promising performance in the newly tackled case of spatial splicing, on both synthetic and real-world videos.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Context-aware TFL: A Universal Context-aware Contrastive Learning Framework for Temporal Forgery Localization
Most research efforts in the multimedia forensics domain have focused on detecting forgery audio-visual content and reached sound achievements. However, these works only consider deepfake detection as a classification ta…
Anomaly DetectionContrastive LearningDeepFake DetectionFace Swapping+1OmniFD: A Unified Model for Versatile Face Forgery Detection
Face forgery detection encompasses multiple critical tasks, including identifying forged images and videos and localizing manipulated regions and temporal segments. Current approaches typically employ task-specific model…
Video ClassificationMulti-Task LearningDDNet: A Dual-Stream Graph Learning and Disentanglement Framework for Temporal Forgery Localization
The rapid evolution of AIGC technology enables misleading viewers by tampering mere small segments within a video, rendering video-level detection inaccurate and unpersuasive. Consequently, temporal forgery localization …
Graph LearningForgery Attack Detection in Surveillance Video Streams Using Wi-Fi Channel State Information
The cybersecurity breaches expose surveillance video streams to forgery attacks, under which authentic streams are falsified to hide unauthorized activities. Traditional video forensics approaches can localize forgery tr…
Time SeriesTime Series AnalysisVideo ForensicsUMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization
The emergence of artificial intelligence-generated content (AIGC) has raised concerns about the authenticity of multimedia content in various fields. However, existing research for forgery content detection has focused m…
Binary ClassificationTemporal Forgery LocalizationVideo Inpainting