paper-with-me

홈 › Papers

Detecting Deepfake by Creating Spatio-Temporal Regularity Disruption

2022-07-21 · Jiazhi Guan, Hang Zhou, Mingming Gong, Errui Ding, Jingdong Wang, Youjian Zhao

Despite encouraging progress in deepfake detection, generalization to unseen forgery types remains a significant challenge due to the limited forgery clues explored during training. In contrast, we notice a common phenomenon in deepfake: fake video creation inevitably disrupts the statistical regularity in original videos. Inspired by this observation, we propose to boost the generalization of deepfake detection by distinguishing the "regularity disruption" that does not appear in real videos. Specifically, by carefully examining the spatial and temporal properties, we propose to disrupt a real video through a Pseudo-fake Generator and create a wide range of pseudo-fake videos for training. Such practice allows us to achieve deepfake detection without using fake videos and improves the generalization ability in a simple and efficient manner. To jointly capture the spatial and temporal disruptions, we propose a Spatio-Temporal Enhancement block to learn the regularity disruption across space and time on our self-created videos. Through comprehensive experiments, our method exhibits excellent performance on several datasets.

📄 PDF Abstract BibTeX arXiv:2207.10402

Code (0)

등록된 구현이 없습니다.

Tasks

DeepFake DetectionFace Swapping

Similar Papers 제목 키워드 기반

Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectories

2024-04-28 · Zongmei Chen, Xin Liao, Xiaoshuai Wu, Yanxiang Chen

The misuse of deepfake technology by malicious actors poses a potential threat to nations, societies, and individuals. However, existing methods for detecting deepfakes primarily focus on uncompressed videos, such as noi…

Face Swapping

Spatio-temporal Features for Generalized Detection of Deepfake Videos

2020-10-22 · Ipek Ganiyusufoglu, L. Minh Ngô, Nedko Savov, Sezer Karaoglu 외

For deepfake detection, video-level detectors have not been explored as extensively as image-level detectors, which do not exploit temporal data. In this paper, we empirically show that existing approaches on image and s…

DeepFake DetectionFace Swapping

Deepfake Video Detection with Spatiotemporal Dropout Transformer

2022-07-14 · Daichi Zhang, Fanzhao Lin, Yingying Hua, Pengju Wang 외

While the abuse of deepfake technology has caused serious concerns recently, how to detect deepfake videos is still a challenge due to the high photo-realistic synthesis of each frame. Existing image-level approaches oft…

Data AugmentationFace Swapping

Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistencies

2025-04-02 · Soumyya Kanti Datta, Shan Jia, Siwei Lyu

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of th…

Face Swapping

Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization

2023-05-03 · Zhixi Cai, Shreya Ghosh, Abhinav Dhall, Tom Gedeon 외

Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting whether a video is real or fake. This is …

Binary ClassificationDeepFake DetectionFace SwappingTemporal Forgery Localization