paper-with-me

Papers

DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion

2024-10-06 · Ke Sun, Shen Chen, Taiping Yao, Hong Liu, Xiaoshuai Sun, Shouhong Ding, Rongrong Ji

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse nature of facial manipulations. In this paper, we revisit the generation process and identify a universal principle: Deepfake images inherently contain information from both source and target identities, while genuine faces maintain a consistent identity. Building upon this insight, we introduce DiffusionFake, a novel plug-and-play framework that reverses the generative process of face forgeries to enhance the generalization of detection models. DiffusionFake achieves this by injecting the features extracted by the detection model into a frozen pre-trained Stable Diffusion model, compelling it to reconstruct the corresponding target and source images. This guided reconstruction process constrains the detection network to capture the source and target related features to facilitate the reconstruction, thereby learning rich and disentangled representations that are more resilient to unseen forgeries. Extensive experiments demonstrate that DiffusionFake significantly improves cross-domain generalization of various detector architectures without introducing additional parameters during inference. Our Codes are available in https://github.com/skJack/DiffusionFake.git.

📄 PDF Abstract BibTeX arXiv:2410.04372

Code (1)

skjack/diffusionfake 공식 구현 pytorch

Tasks

DeepFake DetectionDomain GeneralizationFace Swapping

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Deepfake Detection Generalization with Diffusion Noise

2026-04-16 · Hongyuan Qi, Wenjin Hou, Hehe Fan, Jun Xiao arxiv

Deepfake detectors face growing challenges in generalization as new image synthesis techniques emerge. In particular, deepfakes generated by diffusion models are highly photorealistic and often evade detectors trained on…

DeepFake Detection

Decoupling Forgery Semantics for Generalizable Deepfake Detection

2024-06-14 · Wei Ye, Xinan He, Feng Ding

In this paper, we propose a novel method for detecting DeepFakes, enhancing the generalization of detection through semantic decoupling. There are now multiple DeepFake forgery technologies that not only possess unique f…

DeepFake DetectionFace Swapping

Penny-Wise and Pound-Foolish in Deepfake Detection

2024-08-15 · Yabin Wang, Zhiwu Huang, Su Zhou, Adam Prugel-Bennett 외

The diffusion of deepfake technologies has sparked serious concerns about its potential misuse across various domains, prompting the urgent need for robust detection methods. Despite advancement, many current approaches …

DeepFake DetectionFace SwappingLanguage Modelling

Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection

2024-03-20 · Davide Alessandro Coccomini, Roberto Caldelli, Claudio Gennaro, Giuseppe Fiameni 외

Deepfake detectors are typically trained on large sets of pristine and generated images, resulting in limited generalization capacity; they excel at identifying deepfakes created through methods encountered during traini…

DeepFake DetectionFace SwappingImage Generation

Wavelet-Driven Generalizable Framework for Deepfake Face Forgery Detection

2024-09-26 · Lalith Bharadwaj Baru, Rohit Boddeda, Shilhora Akshay Patel, Sai Mohan Gajapaka

The evolution of digital image manipulation, particularly with the advancement of deep generative models, significantly challenges existing deepfake detection methods, especially when the origin of the deepfake is obscur…

DeepFake DetectionFace SwappingImage Manipulation