Aggregating Layers for Deepfake Detection
The increasing popularity of facial manipulation (Deepfakes) and synthetic face creation raises the need to develop robust forgery detection solutions. Crucially, most work in this domain assume that the Deepfakes in the test set come from the same Deepfake algorithms that were used for training the network. This is not how things work in practice. Instead, we consider the case where the network is trained on one Deepfake algorithm, and tested on Deepfakes generated by another algorithm. Typically, supervised techniques follow a pipeline of visual feature extraction from a deep backbone, followed by a binary classification head. Instead, our algorithm aggregates features extracted across all layers of one backbone network to detect a fake. We evaluate our approach on two domains of interest - Deepfake detection and Synthetic image detection, and find that we achieve SOTA results.
Code (2)
Tasks
Binary ClassificationDeepFake DetectionFace SwappingSynthetic Image DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection
This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial,…
Audio Deepfake DetectionDeepFake DetectionFace SwappingSelf-Supervised LearningGC-ConsFlow: Leveraging Optical Flow Residuals and Global Context for Robust Deepfake Detection
The rapid development of Deepfake technology has enabled the generation of highly realistic manipulated videos, posing severe social and ethical challenges. Existing Deepfake detection methods primarily focused on either…
DeepFake DetectionFace SwappingOptical Flow EstimationDeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
Existing deepfake detection methods fail to generalize well to unseen or degraded samples, which can be attributed to the over-fitting of low-level forgery patterns. Here we argue that high-level semantics are also indis…
DeepFake DetectionFace SwappingBeyond Seeing Is Believing: On Crowdsourced Detection of Audiovisual Deepfakes
Deepfakes are increasingly realistic and easy to produce, raising concerns about the reliability of human judgments in misinformation settings. We study audiovisual deepfake detection by measuring how consistently crowd …
DeepFake DetectionLightweight Joint Audio-Visual Deepfake Detection via Single-Stream Multi-Modal Learning Framework
Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly e…
audio-visual learningDeepFake DetectionFace SwappingMisinformation+1