paper-with-me

Papers

Identity-Driven DeepFake Detection

2020-12-07 · Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang, Nenghai Yu, Dong Chen, Fang Wen, Baining Guo

DeepFake detection has so far been dominated by `artifact-driven'' methods and the detection performance significantly degrades when either the type of image artifacts is unknown or the artifacts are simply too hard to find. In this work, we present an alternative approach: Identity-Driven DeepFake Detection. Our approach takes as input the suspect image/video as well as the target identity information (a reference image or video). We output a decision on whether the identity in the suspect image/video is the same as the target identity. Our motivation is to prevent the most common and harmful DeepFakes that spread false information of a targeted person. The identity-based approach is fundamentally different in that it does not attempt to detect image artifacts. Instead, it focuses on whether the identity in the suspect image/video is true. To facilitate research on identity-based detection, we present a new large scale dataset `Vox-DeepFake", in which each suspect content is associated with multiple reference images collected from videos of a target identity. We also present a simple identity-based detection algorithm called the OuterFace, which may serve as a baseline for further research. Even trained without fake videos, the OuterFace algorithm achieves superior detection accuracy and generalizes well to different DeepFake methods, and is robust with respect to video degradation techniques -- a performance not achievable with existing detection algorithms.

📄 PDF Abstract BibTeX arXiv:2012.03930

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake DetectionFace Swapping

Similar Papers 제목 키워드 기반

PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis

2025-10-16 · Soumyya Kanti Datta, Tanvi Ranga, Chengzhe Sun, Siwei Lyu arxiv

The rise of manipulated media has made deepfakes a particularly insidious threat, involving various generative manipulations such as lip-sync modifications, face-swaps, and avatar-driven facial synthesis. Conventional de…

DeepFake Detection

Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

2022-04-13 · Zhixi Cai, Kalin Stefanov, Abhinav Dhall, Munawar Hayat

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based sp…

BenchmarkingDeepFake DetectionTemporal Forgery Localization

In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol

2024-05-01 · Wei-Han Wang, Chin-Yuan Yeh, Hsi-Wen Chen, De-Nian Yang 외

As deep generative models advance, we anticipate deepfakes achieving "perfection"-generating no discernible artifacts or noise. However, current deepfake detectors, intentionally or inadvertently, rely on such artifacts …

DeepFake DetectionFace Swapping

DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencoder

2024-12-10 · Peipeng Yu, Hui Gao, Zhitao Huang, Zhihua Xia 외

Recent advances in deepfake forensics have primarily focused on improving the classification accuracy and generalization performance. Despite enormous progress in detection accuracy across a wide variety of forgery algor…

Face Swapping

Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization

2022-10-26 · CVPR 2023 1 · Shichao Dong, Jin Wang, Renhe Ji, Jiajun Liang 외

In this paper, we analyse the generalization ability of binary classifiers for the task of deepfake detection. We find that the stumbling block to their generalization is caused by the unexpected learned identity represe…

DeepFake DetectionFace Swapping