Unconstrained Lip-synchronization
3개 벤치마크 · 논문 4편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild
MARLIN: Masked Autoencoder for facial video Representation LearnINg
Towards Automatic Face-to-Face Translation
You said that?
Papers
MARLIN: Masked Autoencoder for facial video Representation LearnINg
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Express…
Action ClassificationAttributeDeepFake DetectionEmotion Classification+8A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild
In this work, we investigate the problem of lip-syncing a talking face video of an arbitrary identity to match a target speech segment. Current works excel at producing accurate lip movements on a static image or videos …
AllMORPHTalking Face GenerationTalking Head Generation+1Towards Automatic Face-to-Face Translation
In light of the recent breakthroughs in automatic machine translation systems, we propose a novel approach that we term as "Face-to-Face Translation". As today's digital communication becomes increasingly visual, we argu…
Face to Face TranslationMachine TranslationSpeech-to-Speech TranslationTranslation+1You said that?
We present a method for generating a video of a talking face. The method takes as inputs: (i) still images of the target face, and (ii) an audio speech segment; and outputs a video of the target face lip synched with the…
DecoderUnconstrained Lip-synchronization