paper-with-me

Papers

ID-Reveal: Identity-aware DeepFake Video Detection

2020-12-04 · ICCV 2021 10 · Davide Cozzolino, Andreas Rössler, Justus Thies, Matthias Nießner, Luisa Verdoliva

A major challenge in DeepFake forgery detection is that state-of-the-art algorithms are mostly trained to detect a specific fake method. As a result, these approaches show poor generalization across different types of facial manipulations, e.g., from face swapping to facial reenactment. To this end, we introduce ID-Reveal, a new approach that learns temporal facial features, specific of how a person moves while talking, by means of metric learning coupled with an adversarial training strategy. The advantage is that we do not need any training data of fakes, but only train on real videos. Moreover, we utilize high-level semantic features, which enables robustness to widespread and disruptive forms of post-processing. We perform a thorough experimental analysis on several publicly available benchmarks. Compared to state of the art, our method improves generalization and is more robust to low-quality videos, that are usually spread over social networks. In particular, we obtain an average improvement of more than 15% in terms of accuracy for facial reenactment on high compressed videos.

📄 PDF Abstract BibTeX arXiv:2012.02512

Code (1)

grip-unina/id-reveal 공식 구현 pytorch

Tasks

Face SwappingMetric Learning

Similar Papers 제목 키워드 기반

Identity-Driven DeepFake Detection

2020-12-07 · Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang 외

DeepFake detection has so far been dominated by ``artifact-driven'' methods and the detection performance significantly degrades when either the type of image artifacts is unknown or the artifacts are simply too hard to …

DeepFake DetectionFace Swapping

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

2023-11-17 · Peter Grönquist, Yufan Ren, Qingyi He, Alessio Verardo 외

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unn…

DeepFake DetectionFace SwappingOptical Flow Estimation

In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol

2024-05-01 · Wei-Han Wang, Chin-Yuan Yeh, Hsi-Wen Chen, De-Nian Yang 외

As deep generative models advance, we anticipate deepfakes achieving "perfection"-generating no discernible artifacts or noise. However, current deepfake detectors, intentionally or inadvertently, rely on such artifacts …

DeepFake DetectionFace Swapping

MINTIME: Multi-Identity Size-Invariant Video Deepfake Detection

2022-11-20 · Davide Alessandro Coccomini, Giorgos Kordopatis Zilos, Giuseppe Amato, Roberto Caldelli 외

In this paper, we introduce MINTIME, a video deepfake detection approach that captures spatial and temporal anomalies and handles instances of multiple people in the same video and variations in face sizes. Previous appr…

ClassificationDeepFake DetectionFace Swapping

Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization

2022-04-13 · Zhixi Cai, Kalin Stefanov, Abhinav Dhall, Munawar Hayat

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based sp…

BenchmarkingDeepFake DetectionTemporal Forgery Localization