paper-with-me

Papers

DFCon: Attention-Driven Supervised Contrastive Learning for Robust Deepfake Detection

2025-01-28 · MD Sadik Hossain Shanto, Mahir Labib Dihan, Souvik Ghosh, Riad Ahmed Anonto, Hafijul Hoque Chowdhury, Abir Muhtasim, Rakib Ahsan, Md Tanvir Hassan, MD Roqunuzzaman Sojib, Sheikh Azizul Hakim, M. Saifur Rahman

This report presents our approach for the IEEE SP Cup 2025: Deepfake Face Detection in the Wild (DFWild-Cup), focusing on detecting deepfakes across diverse datasets. Our methodology employs advanced backbone models, including MaxViT, CoAtNet, and EVA-02, fine-tuned using supervised contrastive loss to enhance feature separation. These models were specifically chosen for their complementary strengths. Integration of convolution layers and strided attention in MaxViT is well-suited for detecting local features. In contrast, hybrid use of convolution and attention mechanisms in CoAtNet effectively captures multi-scale features. Robust pretraining with masked image modeling of EVA-02 excels at capturing global features. After training, we freeze the parameters of these models and train the classification heads. Finally, a majority voting ensemble is employed to combine the predictions from these models, improving robustness and generalization to unseen scenarios. The proposed system addresses the challenges of detecting deepfakes in real-world conditions and achieves a commendable accuracy of 95.83% on the validation dataset.

📄 PDF Abstract BibTeX arXiv:2501.16704

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDeepFake DetectionFace DetectionFace Swapping

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Supervised Contrastive Loss 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

2022-04-13 · Zhixi Cai, Kalin Stefanov, Abhinav Dhall, Munawar Hayat

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based sp…

BenchmarkingDeepFake DetectionTemporal Forgery Localization

DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning

2021-04-23 · Sheldon Fung, Xuequan Lu, Chao Zhang, Chang-Tsun Li

Face deepfake detection has seen impressive results recently. Nearly all existing deep learning techniques for face deepfake detection are fully supervised and require labels during training. In this paper, we design a n…

Contrastive LearningDeepFake DetectionFace Swapping

HierCon: Hierarchical Contrastive Attention for Audio Deepfake Detection

2026-02-01 · Zhili Nicholas Liang, Soyeon Caren Han, Qizhou Wang, Christopher Leckie arxiv

Audio deepfakes generated by modern TTS and voice conversion systems are increasingly difficult to distinguish from real speech, raising serious risks for security and online trust. While state-of-the-art self-supervised…

Audio Deepfake DetectionContrastive LearningVoice Conversion

DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution

2025-05-07 · Ming-Hui Liu, Xiao-Qian Liu, Xin Luo, Xin-Shun Xu

Deepfake attribution (DFA) aims to perform multiclassification on different facial manipulation techniques, thereby mitigating the detrimental effects of forgery content on the social order and personal reputations. Howe…

Contrastive LearningDisentanglementFace SwappingNovel Class Discovery

KLASSify to Verify: Audio-Visual Deepfake Detection Using SSL-based Audio and Handcrafted Visual Features

2025-08-10 · Ivan Kukanov, Jun Wah Ng arxiv

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of det…

Self-Supervised LearningDeepFake Detection