paper-with-me

홈 › Papers

Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectories

2024-04-28 · Zongmei Chen, Xin Liao, Xiaoshuai Wu, Yanxiang Chen

The misuse of deepfake technology by malicious actors poses a potential threat to nations, societies, and individuals. However, existing methods for detecting deepfakes primarily focus on uncompressed videos, such as noise characteristics, local textures, or frequency statistics. When applied to compressed videos, these methods experience a decrease in detection performance and are less suitable for real-world scenarios. In this paper, we propose a deepfake video detection method based on 3D spatiotemporal trajectories. Specifically, we utilize a robust 3D model to construct spatiotemporal motion features, integrating feature details from both 2D and 3D frames to mitigate the influence of large head rotation angles or insufficient lighting within frames. Furthermore, we separate facial expressions from head movements and design a sequential analysis method based on phase space motion trajectories to explore the feature differences between genuine and fake faces in deepfake videos. We conduct extensive experiments to validate the performance of our proposed method on several compressed deepfake benchmarks. The robustness of the well-designed features is verified by calculating the consistent distribution of facial landmarks before and after video compression.Our method yields satisfactory results and showcases its potential for practical applications.

📄 PDF Abstract BibTeX arXiv:2404.18149

Code (0)

등록된 구현이 없습니다.

Tasks

Face Swapping

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Deepfake Video Detection with Spatiotemporal Dropout Transformer

2022-07-14 · Daichi Zhang, Fanzhao Lin, Yingying Hua, Pengju Wang 외

While the abuse of deepfake technology has caused serious concerns recently, how to detect deepfake videos is still a challenge due to the high photo-realistic synthesis of each frame. Existing image-level approaches oft…

Data AugmentationFace Swapping

Deepfake Detection using Spatiotemporal Convolutional Networks

2020-06-26 · Oscar de Lima, Sean Franklin, Shreshtha Basu, Blake Karwoski 외

Better generative models and larger datasets have led to more realistic fake videos that can fool the human eye but produce temporal and spatial artifacts that deep learning approaches can detect. Most current Deepfake d…

DeepFake DetectionFace Swapping

DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection

2024-10-31 · Fan Nie, Jiangqun Ni, Jian Zhang, Bin Zhang 외

With the advancement of deepfake generation techniques, the importance of deepfake detection in protecting multimedia content integrity has become increasingly obvious. Recently, temporal inconsistency clues have been ex…

DecoderDeepFake DetectionFace Swapping

Explaining Deepfake Detection by Analysing Image Matching

2022-07-20 · Shichao Dong, Jin Wang, Jiajun Liang, Haoqiang Fan 외

This paper aims to interpret how deepfake detection models learn artifact features of images when just supervised by binary labels. To this end, three hypotheses from the perspective of image matching are proposed as fol…

DeepFake DetectionFace SwappingVideo Compression

Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Features

2021-04-09 · CVPR 2021 1 · Zekun Sun, Yujie Han, Zeyu Hua, Na Ruan 외

Deepfakes is a branch of malicious techniques that transplant a target face to the original one in videos, resulting in serious problems such as infringement of copyright, confusion of information, or even public panic. …

Open-Ended Question Answering