paper-with-me

홈 › Papers

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

2023-12-07 · Chunlei Peng, Huiqing Guo, Decheng Liu, Nannan Wang, Ruimin Hu, Xinbo Gao

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a challenging problem due to the complexity and variability of face forgery techniques. Existing Deepfake detection methods are often devoted to extracting features by designing sophisticated networks but ignore the influence of perceptual quality of faces. Considering the complexity of the quality distribution of both real and fake faces, we propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces with varying image quality by mining the perceptual forgery fidelity of face images. Specifically, we improve the model's ability to identify complex samples by mapping real and fake face data of different qualities to different scores to distinguish them in a more detailed way. In addition, we propose a network structure called Symmetric Spatial Attention Augmentation based vision Transformer (SSAAFormer), which uses the symmetry of face images to promote the network to model the geographic long-distance relationship at the shallow level and augment local features. Extensive experiments on multiple benchmark datasets demonstrate the superiority of the proposed method over state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2312.04961

Code (2)

shimmer-ghq/deepfidelity 공식 구현 pytorch
FaceOnLive/DeepFake-Detection-SDK-Linux

Tasks

DeepFake DetectionFace Swapping

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

A Quality-Centric Framework for Generic Deepfake Detection

2024-11-08 · Wentang Song, Zhiyuan Yan, Yuzhen Lin, Taiping Yao 외

Detecting AI-generated images, particularly deepfakes, has become increasingly crucial, with the primary challenge being the generalization to previously unseen manipulation methods. This paper tackles this issue by leve…

Data AugmentationDeepFake DetectionFace Swapping

Deep Learning Technology for Face Forgery Detection: A Survey

2024-09-22 · Lixia Ma, Puning Yang, Yuting Xu, Ziming Yang 외

Currently, the rapid development of computer vision and deep learning has enabled the creation or manipulation of high-fidelity facial images and videos via deep generative approaches. This technology, also known as deep…

DeepFake DetectionDeep LearningFace SwappingMisinformation+1

$X^2$-DFD: A framework for eXplainable and eXtendable Deepfake Detection

2024-10-08 · Yize Chen, Zhiyuan Yan, Siwei Lyu, Baoyuan Wu

Detecting deepfakes has become an important task. Most existing detection methods provide only real/fake predictions without offering human-comprehensible explanations. Recent studies leveraging MLLMs for deepfake detect…

DeepFake DetectionFace Swapping

Decoupling Forgery Semantics for Generalizable Deepfake Detection

2024-06-14 · Wei Ye, Xinan He, Feng Ding

In this paper, we propose a novel method for detecting DeepFakes, enhancing the generalization of detection through semantic decoupling. There are now multiple DeepFake forgery technologies that not only possess unique f…

DeepFake DetectionFace Swapping

Spatial-Temporal Frequency Forgery Clue for Video Forgery Detection in VIS and NIR Scenario

2022-07-05 · Yukai Wang, Chunlei Peng, Decheng Liu, Nannan Wang 외

In recent years, with the rapid development of face editing and generation, more and more fake videos are circulating on social media, which has caused extreme public concerns. Existing face forgery detection methods bas…