paper-with-me

Papers

A Robust Interactive Facial Animation Editing System

2020-07-18 · Eloïse Berson, Catherine Soladié, Vincent Barrielle, Nicolas Stoiber

Over the past few years, the automatic generation of facial animation for virtual characters has garnered interest among the animation research and industry communities. Recent research contributions leverage machine-learning approaches to enable impressive capabilities at generating plausible facial animation from audio and/or video signals. However, these approaches do not address the problem of animation edition, meaning the need for correcting an unsatisfactory baseline animation or modifying the animation content itself. In facial animation pipelines, the process of editing an existing animation is just as important and time-consuming as producing a baseline. In this work, we propose a new learning-based approach to easily edit a facial animation from a set of intuitive control parameters. To cope with high-frequency components in facial movements and preserve a temporal coherency in the animation, we use a resolution-preserving fully convolutional neural network that maps control parameters to blendshapes coefficients sequences. We stack an additional resolution-preserving animation autoencoder after the regressor to ensure that the system outputs natural-looking animation. The proposed system is robust and can handle coarse, exaggerated edits from non-specialist users. It also retains the high-frequency motion of the facial animation.

📄 PDF Abstract BibTeX arXiv:2007.09367

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

3DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing

2023-12-01 · Balamurugan Thambiraja, Sadegh Aliakbarian, Darren Cosker, Justus Thies

We present 3DiFACE, a novel method for personalized speech-driven 3D facial animation and editing. While existing methods deterministically predict facial animations from speech, they overlook the inherent one-to-many re…

Diversity

3DiFACE: Synthesizing and Editing Holistic 3D Facial Animation

2025-09-30 · Balamurugan Thambiraja, Malte Prinzler, Sadegh Aliakbarian, Darren Cosker 외 arxiv

Creating personalized 3D animations with precise control and realistic head motions remains challenging for current speech-driven 3D facial animation methods. Editing these animations is especially complex and time consu…

Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars

2025-08-22 · NVIDIA, :, Chaeyeon Chung, Ilya Fedorov 외 arxiv

Audio-driven facial animation presents an effective solution for animating digital avatars. In this paper, we detail the technical aspects of NVIDIA Audio2Face-3D, including data acquisition, network architecture, retarg…

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

2022-07-19 · Jingwang Ling, Zhibo Wang, Ming Lu, Quan Wang 외

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details. This paper augments morphable models in r…

EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editing

2026-01-15 · Diqiong Jiang, Kai Zhu, Dan Song, Jian Chang 외 arxiv

Speech-driven 3D facial animation aims to generate realistic and expressive facial motions directly from audio. While recent methods achieve high-quality lip synchronization, they often rely on discrete emotion categorie…