paper-with-me

홈 › Papers

Learning to mask: Towards generalized face forgery detection

2022-12-29 · Jianwei Fei, Yunshu Dai, Huaming Wang, Zhihua Xia

Generalizability to unseen forgery types is crucial for face forgery detectors. Recent works have made significant progress in terms of generalization by synthetic forgery data augmentation. In this work, we explore another path for improving the generalization. Our goal is to reduce the features that are easy to learn in the training phase, so as to reduce the risk of overfitting on specific forgery types. Specifically, in our method, a teacher network takes as input the face images and generates an attention map of the deep features by a diverse multihead attention ViT. The attention map is used to guide a student network to focus on the low-attended features by reducing the highly-attended deep features. A deep feature mixup strategy is also proposed to synthesize forgeries in the feature domain. Experiments demonstrate that, without data augmentation, our method is able to achieve promising performances on unseen forgeries and highly compressed data.

📄 PDF Abstract BibTeX arXiv:2212.14309

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

Local Relation Learning for Face Forgery Detection

2021-05-06 · Shen Chen, Taiping Yao, Yang Chen, Shouhong Ding 외

With the rapid development of facial manipulation techniques, face forgery detection has received considerable attention in digital media forensics due to security concerns. Most existing methods formulate face forgery d…

Relation

FedForgery: Generalized Face Forgery Detection with Residual Federated Learning

2022-10-18 · Decheng Liu, Zhan Dang, Chunlei Peng, Yu Zheng 외

With the continuous development of deep learning in the field of image generation models, a large number of vivid forged faces have been generated and spread on the Internet. These high-authenticity artifacts could grow …

Federated LearningImage Generation

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

2023-07-21 · Decheng Liu, Tao Chen, Chunlei Peng, Nannan Wang 외

Due to the successful development of deep image generation technology, visual data forgery detection would play a more important role in social and economic security. Existing forgery detection methods suffer from unsati…

Image Generation

Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues

2022-08-10 · Zitong Yu, Rizhao Cai, Zhi Li, Wenhan Yang 외

Face anti-spoofing (FAS) and face forgery detection play vital roles in securing face biometric systems from presentation attacks (PAs) and vicious digital manipulation (e.g., deepfakes). Despite promising performance up…

BenchmarkingDeepFake DetectionFace Anti-SpoofingFace Swapping+1

MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection

2024-04-12 · Chenqi Kong, Anwei Luo, Peijun Bao, Yi Yu 외

Deepfakes have recently raised significant trust issues and security concerns among the public. Compared to CNN face forgery detectors, ViT-based methods take advantage of the expressivity of transformers, achieving supe…

Mixture-of-Experts