Implicit Warping for Animation with Image Sets
We present a new implicit warping framework for image animation using sets of source images through the transfer of the motion of a driving video. A single cross- modal attention layer is used to find correspondences between the source images and the driving image, choose the most appropriate features from different source images, and warp the selected features. This is in contrast to the existing methods that use explicit flow-based warping, which is designed for animation using a single source and does not extend well to multiple sources. The pick-and-choose capability of our framework helps it achieve state-of-the-art results on multiple datasets for image animation using both single and multiple source images. The project website is available at https://deepimagination.cc/implicit warping/
Code (0)
등록된 구현이 없습니다.
Tasks
Image AnimationSimilar Papers 제목 키워드 기반
SynergyWarpNet: Attention-Guided Cooperative Warping for Neural Portrait Animation
Recent advances in neural portrait animation have demonstrated remarked potential for applications in virtual avatars, telepresence, and digital content creation. However, traditional explicit warping approaches often st…
PriorityCut: Occlusion-guided Regularization for Warp-based Image Animation
Image animation generates a video of a source image following the motion of a driving video. State-of-the-art self-supervised image animation approaches warp the source image according to the motion of the driving video …
Image AnimationvalidImage2Gif: Generating Continuous Realistic Animations with Warping NODEs
Generating smooth animations from a limited number of sequential observations has a number of applications in vision. For example, it can be used to increase number of frames per second, or generating a new trajectory on…
Generative Adversarial NetworkVideo Frame InterpolationAnimating Through Warping: an Efficient Method for High-Quality Facial Expression Animation
Advances in deep neural networks have considerably improved the art of animating a still image without operating in 3D domain. Whereas, prior arts can only animate small images (typically no larger than 512x512) due to m…
4kGeometry Driven Progressive Warping for One-Shot Face Animation
Face animation aims at creating photo-realistic portrait videos with animated poses and expressions. A common practice is to generate displacement fields that are used to warp pixels and features from source to target. H…
Face Model