paper-with-me

홈 › Papers

Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation

2025-11-10 · Yuxuan Zhou, Tao Yu, Wen Huang, Yuheng Zhang, Tao Dai, Shu-Tao Xia arxiv

The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key question: Is a single static augmentation sufficient, or does the diversity of forgery features demand dynamic approaches? We argue existing methods overlook the evolving complexity of real-world forgeries (e.g., facial warping, expression manipulation), which fixed policies cannot fully simulate. To address this, we propose CRDA (Curriculum Reinforcement-Learning Data Augmentation), a novel framework guiding detectors to progressively master multi-domain forgery features from simple to complex. CRDA synthesizes augmented samples via a configurable pool of forgery operations and dynamically generates adversarial samples tailored to the detector's current learning state. Central to our approach is integrating reinforcement learning (RL) and causal inference. An RL agent dynamically selects augmentation actions based on detector performance to efficiently explore the vast augmentation space, adapting to increasingly challenging forgeries. Simultaneously, the agent introduces action space variations to generate heterogeneous forgery patterns, guided by causal inference to mitigate spurious correlations-suppressing task-irrelevant biases and focusing on causally invariant features. This integration ensures robust generalization by decoupling synthetic augmentation patterns from the model's learned representations. Extensive experiments show our method significantly improves detector generalizability, outperforming SOTA methods across multiple cross-domain datasets.

📄 PDF Abstract BibTeX arXiv:2511.07051

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningDeepFake DetectionData AugmentationCausal Inference

Similar Papers 제목 키워드 기반

DeiTFake: Deepfake Detection Model using DeiT Multi-Stage Training

2025-11-15 · Saksham Kumar, Ashish Singh, Srinivasarao Thota, Sunil Kumar Singh 외 arxiv

Deepfakes are major threats to the integrity of digital media. We propose DeiTFake, a DeiT-based transformer and a novel two-stage progressive training strategy with increasing augmentation complexity. The approach appli…

Knowledge DistillationDeepFake Detection

Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection

2024-09-22 · Yuzhen Lin, Wentang Song, Bin Li, Yuezun Li 외

Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to…

DeepFake DetectionFace Swapping

Hybrid Transformer Network for Deepfake Detection

2022-08-11 · Sohail Ahmed Khan, Duc-Tien Dang-Nguyen

Deepfake media is becoming widespread nowadays because of the easily available tools and mobile apps which can generate realistic looking deepfake videos/images without requiring any technical knowledge. With further adv…

DeepFake DetectionFace Swapping

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

2023-12-07 · Chunlei Peng, Huiqing Guo, Decheng Liu, Nannan Wang 외

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detect…

DeepFake DetectionFace Swapping

TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection

2023-06-27 · Jie Liu, Zhiba Su, Hui Huang, Caiyan Wan 외

Thanks to recent advancements in end-to-end speech modeling technology, it has become increasingly feasible to imitate and clone a user`s voice. This leads to a significant challenge in differentiating between authentic …

Audio Deepfake DetectionData AugmentationDeepFake DetectionFace Swapping