Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation
The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key question: Is a single static augmentation sufficient, or does the diversity of forgery features demand dynamic approaches? We argue existing methods overlook the evolving complexity of real-world forgeries (e.g., facial warping, expression manipulation), which fixed policies cannot fully simulate. To address this, we propose CRDA (Curriculum Reinforcement-Learning Data Augmentation), a novel framework guiding detectors to progressively master multi-domain forgery features from simple to complex. CRDA synthesizes augmented samples via a configurable pool of forgery operations and dynamically generates adversarial samples tailored to the detector's current learning state. Central to our approach is integrating reinforcement learning (RL) and causal inference. An RL agent dynamically selects augmentation actions based on detector performance to efficiently explore the vast augmentation space, adapting to increasingly challenging forgeries. Simultaneously, the agent introduces action space variations to generate heterogeneous forgery patterns, guided by causal inference to mitigate spurious correlations-suppressing task-irrelevant biases and focusing on causally invariant features. This integration ensures robust generalization by decoupling synthetic augmentation patterns from the model's learned representations. Extensive experiments show our method significantly improves detector generalizability, outperforming SOTA methods across multiple cross-domain datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningDeepFake DetectionData AugmentationCausal InferenceSimilar Papers 제목 키워드 기반
DeiTFake: Deepfake Detection Model using DeiT Multi-Stage Training
Deepfakes are major threats to the integrity of digital media. We propose DeiTFake, a DeiT-based transformer and a novel two-stage progressive training strategy with increasing augmentation complexity. The approach appli…
Knowledge DistillationDeepFake DetectionFake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection
Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to…
DeepFake DetectionFace SwappingHybrid Transformer Network for Deepfake Detection
Deepfake media is becoming widespread nowadays because of the easily available tools and mobile apps which can generate realistic looking deepfake videos/images without requiring any technical knowledge. With further adv…
DeepFake DetectionFace SwappingDeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection
Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detect…
DeepFake DetectionFace SwappingTranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection
Thanks to recent advancements in end-to-end speech modeling technology, it has become increasingly feasible to imitate and clone a user`s voice. This leads to a significant challenge in differentiating between authentic …
Audio Deepfake DetectionData AugmentationDeepFake DetectionFace Swapping