paper-with-me

홈 › Papers

Wavelet-Driven Generalizable Framework for Deepfake Face Forgery Detection

2024-09-26 · Lalith Bharadwaj Baru, Rohit Boddeda, Shilhora Akshay Patel, Sai Mohan Gajapaka

The evolution of digital image manipulation, particularly with the advancement of deep generative models, significantly challenges existing deepfake detection methods, especially when the origin of the deepfake is obscure. To tackle the increasing complexity of these forgeries, we propose \textbf{Wavelet-CLIP}, a deepfake detection framework that integrates wavelet transforms with features derived from the ViT-L/14 architecture, pre-trained in the CLIP fashion. Wavelet-CLIP utilizes Wavelet Transforms to deeply analyze both spatial and frequency features from images, thus enhancing the model's capability to detect sophisticated deepfakes. To verify the effectiveness of our approach, we conducted extensive evaluations against existing state-of-the-art methods for cross-dataset generalization and detection of unseen images generated by standard diffusion models. Our method showcases outstanding performance, achieving an average AUC of 0.749 for cross-data generalization and 0.893 for robustness against unseen deepfakes, outperforming all compared methods. The code can be reproduced from the repo: \url{https://github.com/lalithbharadwajbaru/Wavelet-CLIP}

📄 PDF Abstract BibTeX arXiv:2409.18301

Code (1)

lalithbharadwajbaru/wavelet-clip 공식 구현 pytorch

Tasks

DeepFake DetectionFace SwappingImage Manipulation

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics

2025-07-24 · Yuezun Li, Delong Zhu, Xinjie Cui, Siwei Lyu arxiv

The rapid advancement of AI technologies has significantly increased the diversity of DeepFake videos circulating online, posing a pressing challenge for \textit{generalizable forensics}, \ie, detecting a wide range of u…

A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators

2026-06-12 · Amna Amjid, Sana Qadir, Mehwish Fatima, Raja Khurram Shahzad arxiv

Deepfakes are artificially generated images, audio, or videos that threaten privacy, security, and information integrity. Detecting such content is crucial for countering disinformation, as the latest models generate hig…

DeepFake DetectionData Augmentation

WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks

2025-05-13 · Ziyuan He, Zhiqing Guo, Liejun Wang, Gaobo Yang 외

Deepfake technology poses increasing risks such as privacy invasion and identity theft. To address these threats, we propose WaveGuard, a proactive watermarking framework that enhances robustness and imperceptibility via…

DeepFake DetectionFace SwappingGraph Neural Network

SpectraNet: FFT-assisted Deep Learning Classifier for Deepfake Face Detection

2025-11-24 · Nithira Jayarathne, Naveen Basnayake, Keshawa Jayasundara, Pasindu Dodampegama 외 arxiv

Detecting deepfake images is crucial in combating misinformation. We present a lightweight, generalizable binary classification model based on EfficientNet-B6, fine-tuned with transformation techniques to address severe …

Binary ClassificationDeepFake DetectionFace Detection

Unlocking the Hidden Potential of CLIP in Generalizable Deepfake Detection

2025-03-25 · Andrii Yermakov, Jan Cech, Jiri Matas

This paper tackles the challenge of detecting partially manipulated facial deepfakes, which involve subtle alterations to specific facial features while retaining the overall context, posing a greater detection difficult…

DeepFake DetectionFace SwappingMetric Learningparameter-efficient fine-tuning