paper-with-me

홈 › Papers

Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation

2023-04-17 · Weinan Guan, Wei Wang, Jing Dong, Bo Peng, Tieniu Tan

Detecting maliciously falsified facial images and videos has attracted extensive attention from digital-forensics and computer-vision communities. An important topic in manipulation detection is the localization of the fake regions. Previous work related to forgery detection mostly focuses on the entire faces. However, recent forgery methods have developed to edit important facial components while maintaining others unchanged. This drives us to not only focus on the forgery detection but also fine-grained falsified region segmentation. In this paper, we propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components. With the collaborative manner, detection and segmentation can boost each other efficiently. To enable our study of forgery detection and segmentation, we build a facial forgery dataset consisting of both entire and partial face forgeries with their pixel-level manipulation ground-truth. Experiment results have justified the mutual promotion between forgery detection and manipulated region segmentation. The overall performance of the proposed approach is better than the state-of-the-art detection or segmentation approaches. The visualization results have shown that our proposed model always captures the artifacts on facial regions, which is more reasonable.

📄 PDF Abstract BibTeX arXiv:2304.08078

Code (0)

등록된 구현이 없습니다.

Tasks

Segmentation

Similar Papers 제목 키워드 기반

Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning

2021-12-28 · Qiqi Gu, Shen Chen, Taiping Yao, Yang Chen 외

With the rapid development of facial forgery techniques, forgery detection has attracted more and more attention due to security concerns. Existing approaches attempt to use frequency information to mine subtle artifacts…

WMamba: Wavelet-based Mamba for Face Forgery Detection

2025-01-16 · Siran Peng, Tianshuo Zhang, Li Gao, Xiangyu Zhu 외

With the rapid advancement of deepfake generation technologies, the demand for robust and accurate face forgery detection algorithms has become increasingly critical. Recent studies have demonstrated that wavelet analysi…

Face SwappingMamba

MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection

2024-09-15 · Yaning Zhang, Tianyi Wang, Zitong Yu, Zan Gao 외

The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia, highlighting the urgent need for robust and generalizable face forgery detection (FFD) techniques.…

Face GenerationRepresentation Learning

Unified Face Attack Detection via Fine-Grained Semantic Guidance

2026-07-09 · Ning Jiang, Shijie Yu, Dingheng Zeng, Haiyang Yi 외 arxiv

The growing applications of facial recognition systems are accompanied by increasingly diverse security threats. Existing datasets lack detailed textual descriptions of forgery cues, leading most prior methods to treat f…

Facial Forgery-based Deepfake Detection using Fine-Grained Features

2023-10-10 · Aakash Varma Nadimpalli, Ajita Rattani

Facial forgery by deepfakes has caused major security risks and raised severe societal concerns. As a countermeasure, a number of deepfake detection methods have been proposed. Most of them model deepfake detection as a …

Binary ClassificationDeepFake DetectionFace Swapping