Evolving from Single-modal to Multi-modal Facial Deepfake Detection: A Survey
This survey addresses the critical challenge of deepfake detection amidst the rapid advancements in artificial intelligence. As AI-generated media, including video, audio and text, become more realistic, the risk of misuse to spread misinformation and commit identity fraud increases. Focused on face-centric deepfakes, this work traces the evolution from traditional single-modality methods to sophisticated multi-modal approaches that handle audio-visual and text-visual scenarios. We provide comprehensive taxonomies of detection techniques, discuss the evolution of generative methods from auto-encoders and GANs to diffusion models, and categorize these technologies by their unique attributes. To our knowledge, this is the first survey of its kind. We also explore the challenges of adapting detection methods to new generative models and enhancing the reliability and robustness of deepfake detectors, proposing directions for future research. This survey offers a detailed roadmap for researchers, supporting the development of technologies to counter the deceptive use of AI in media creation, particularly facial forgery. A curated list of all related papers can be found at \href{https://github.com/qiqitao77/Comprehensive-Advances-in-Deepfake-Detection-Spanning-Diverse-Modalities}{https://github.com/qiqitao77/Awesome-Comprehensive-Deepfake-Detection}.
Code (2)
Tasks
DeepFake DetectionFace SwappingMisinformationSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Research on facial expression recognition based on Multimodal data fusion and neural network
Facial expression recognition is a challenging task when neural network is applied to pattern recognition. Most of the current recognition research is based on single source facial data, which generally has the disadvant…
Facial Expression RecognitionFacial Expression Recognition (FER)Multimodal Stress Detection Using Facial Landmarks and Biometric Signals
The development of various sensing technologies is improving measurements of stress and the well-being of individuals. Although progress has been made with single signal modalities like wearables and facial emotion recog…
Emotion RecognitionFacial Emotion RecognitionHEU Emotion: A Large-scale Database for Multi-modal Emotion Recognition in the Wild
The study of affective computing in the wild setting is underpinned by databases. Existing multimodal emotion databases in the real-world conditions are few and small, with a limited number of subjects and expressed in a…
Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving
Diffusion-based technologies have made significant strides, particularly in personalized and customized facialgeneration. However, existing methods face challenges in achieving high-fidelity and detailed identity (ID)con…
DiversityM3D-Net: Multi-Modal 3D Facial Feature Reconstruction Network for Deepfake Detection
With the rapid advancement of deep learning in image generation, facial forgery techniques have achieved unprecedented realism, posing serious threats to cybersecurity and information authenticity. Most existing deepfake…
DeepFake DetectionImage Generation