Papers Constrained Lip-synchronization
“Constrained Lip-synchronization” 태그가 달린 논문 8편 · 필터 해제
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
We propose detection of deepfake videos based on the dissimilarity between the audio and visual modalities, termed as the Modality Dissonance Score (MDS). We hypothesize that manipulation of either modality will lead to …
Constrained Lip-synchronizationDeepFake DetectionFace SwappingTemporal Forgery LocalizationA Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors
Lip sync has emerged as a promising technique for generating mouth movements from audio signals. However, synthesizing a high-resolution and photorealistic virtual news anchor is still challenging. Lack of natural appear…
Constrained Lip-synchronizationImage-to-Image TranslationNeural RenderingReal-Time Lip Sync for Live 2D Animation
The emergence of commercial tools for real-time performance-based 2D animation has enabled 2D characters to appear on live broadcasts and streaming platforms. A key requirement for live animation is fast and accurate lip…
Constrained Lip-synchronizationData AugmentationDeepFakes: a New Threat to Face Recognition? Assessment and Detection
It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the fac…
Constrained Lip-synchronizationFace RecognitionFace SwappingGenerative Adversarial NetworkDynamic Temporal Alignment of Speech to Lips
Many speech segments in movies are re-recorded in a studio during postproduction, to compensate for poor sound quality as recorded on location. Manual alignment of the newly-recorded speech with the original lip movement…
Constrained Lip-synchronizationVideo AlignmentTalking Face Generation by Conditional Recurrent Adversarial Network
Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial mov…
Constrained Lip-synchronizationFace GenerationTalking Face GenerationVideo GenerationSpeech-Driven Facial Reenactment Using Conditional Generative Adversarial Networks
We present a novel approach to generating photo-realistic images of a face with accurate lip sync, given an audio input. By using a recurrent neural network, we achieved mouth landmarks based on audio features. We exploi…
Constrained Lip-synchronizationObamaNet: Photo-realistic lip-sync from text
We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text. Contrary to other published lip-sync approaches, ours is only composed of fully tr…
Constrained Lip-synchronizationtext-to-speechText to Speech