Exploiting Style Latent Flows for Generalizing Deepfake Video Detection
This paper presents a new approach for the detection of fake videos, based on the analysis of style latent vectors and their abnormal behavior in temporal changes in the generated videos. We discovered that the generated facial videos suffer from the temporal distinctiveness in the temporal changes of style latent vectors, which are inevitable during the generation of temporally stable videos with various facial expressions and geometric transformations. Our framework utilizes the StyleGRU module, trained by contrastive learning, to represent the dynamic properties of style latent vectors. Additionally, we introduce a style attention module that integrates StyleGRU-generated features with content-based features, enabling the detection of visual and temporal artifacts. We demonstrate our approach across various benchmark scenarios in deepfake detection, showing its superiority in cross-dataset and cross-manipulation scenarios. Through further analysis, we also validate the importance of using temporal changes of style latent vectors to improve the generality of deepfake video detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDeepFake DetectionFace SwappingSimilar Papers 제목 키워드 기반
On the Exploitation of Deepfake Model Recognition
Despite recent advances in Generative Adversarial Networks (GANs), with special focus to the Deepfake phenomenon there is no a clear understanding neither in terms of explainability nor of recognition of the involved mod…
Face SwappingmodelLatentForensics: Towards frugal deepfake detection in the StyleGAN latent space
The classification of forged videos has been a challenge for the past few years. Deepfake classifiers can now reliably predict whether or not video frames have been tampered with. However, their performance is tied to bo…
Binary ClassificationClassificationDeepFake DetectionFace Swapping+1Face Generation and Editing with StyleGAN: A Survey
Our goal with this survey is to provide an overview of the state of the art deep learning methods for face generation and editing using StyleGAN. The survey covers the evolution of StyleGAN, from PGGAN to StyleGAN3, and …
Deep LearningFace GenerationFace SwappingStyle Transfer+1Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints
Face-swapping deepfakes pose an escalating threat to personal privacy by enabling unauthorized identity manipulation. While adversarial approaches have demonstrated success against black-box face recognition (FR) models,…
Face RecognitionEMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection
With every advancement in generative AI models, forensics is under increasing pressure. The constant emergence of new generation techniques makes it impossible to collect data for each manipulation to train a deepfake de…
Emotion RecognitionDeepFake Detection