paper-with-me

홈 › Papers

Unearthing Common Inconsistency for Generalisable Deepfake Detection

2023-11-20 · Beilin Chu, Xuan Xu, Weike You, Linna Zhou

Deepfake has emerged for several years, yet efficient detection techniques could generalize over different manipulation methods require further research. While current image-level detection method fails to generalize to unseen domains, owing to the domain-shift phenomenon brought by CNN's strong inductive bias towards Deepfake texture, video-level one shows its potential to have both generalization across multiple domains and robustness to compression. We argue that although distinct face manipulation tools have different inherent bias, they all disrupt the consistency between frames, which is a natural characteristic shared by authentic videos. Inspired by this, we proposed a detection approach by capturing frame inconsistency that broadly exists in different forgery techniques, termed unearthing-common-inconsistency (UCI). Concretely, the UCI network based on self-supervised contrastive learning can better distinguish temporal consistency between real and fake videos from multiple domains. We introduced a temporally-preserved module method to introduce spatial noise perturbations, directing the model's attention towards temporal information. Subsequently, leveraging a multi-view cross-correlation learning module, we extensively learn the disparities in temporal representations between genuine and fake samples. Extensive experiments demonstrate the generalization ability of our method on unseen Deepfake domains.

📄 PDF Abstract BibTeX arXiv:2311.11549

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDeepFake DetectionFace SwappingInductive Bias

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detection

2024-10-29 · Dat Nguyen, Marcella Astrid, Enjie Ghorbel, Djamila Aouada

Recently, Vision Transformers (ViTs) have achieved unprecedented effectiveness in the general domain of image classification. Nonetheless, these models remain underexplored in the field of deepfake detection, given their…

DeepFake DetectionFace Swappingimage-classificationImage Classification

DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection

2024-10-31 · Fan Nie, Jiangqun Ni, Jian Zhang, Bin Zhang 외

With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been ex…

DecoderDeepFake DetectionFace Swapping

Towards generalisable and calibrated synthetic speech detection with self-supervised representations

2023-09-11 · Octavian Pascu, Adriana Stan, Dan Oneata, Elisabeta Oneata 외

Generalisation -- the ability of a model to perform well on unseen data -- is crucial for building reliable deepfake detectors. However, recent studies have shown that the current audio deepfake models fall short of this…

2kAudio Deepfake DetectionDeepFake DetectionFace Swapping+1

From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes

2025-04-07 · Long Ma, Zhiyuan Yan, Yize Chen, Jin Xu 외

Detecting deepfakes has been an increasingly important topic, especially given the rapid development of AI generation techniques. In this paper, we ask: How can we build a universal detection framework that is effective …

Face SwappingSpecificitySuper-Resolution

Learning Self-Consistency for Deepfake Detection

2020-12-16 · ICCV 2021 10 · Tianchen Zhao, Xiang Xu, Mingze Xu, Hui Ding 외

We propose a new method to detect deepfake images using the cue of the source feature inconsistency within the forged images. It is based on the hypothesis that images' distinct source features can be preserved and extra…

DeepFake DetectionFace SwappingImage GenerationRepresentation Learning