paper-with-me

Papers

Deep Learning-based Facial Appearance Simulation Driven by Surgically Planned Craniomaxillofacial Bony Movement

2022-10-04 · Xi Fang, Daeseung Kim, Xuanang Xu, Tianshu Kuang, Hannah H. Deng, Joshua C. Barber, Nathan Lampen, Jaime Gateno, Michael A. K. Liebschner, James J. Xia, Pingkun Yan

Simulating facial appearance change following bony movement is a critical step in orthognathic surgical planning for patients with jaw deformities. Conventional biomechanics-based methods such as the finite-element method (FEM) are labor intensive and computationally inefficient. Deep learning-based approaches can be promising alternatives due to their high computational efficiency and strong modeling capability. However, the existing deep learning-based method ignores the physical correspondence between facial soft tissue and bony segments and thus is significantly less accurate compared to FEM. In this work, we propose an Attentive Correspondence assisted Movement Transformation network (ACMT-Net) to estimate the facial appearance by transforming the bony movement to facial soft tissue through a point-to-point attentive correspondence matrix. Experimental results on patients with jaw deformity show that our proposed method can achieve comparable facial change prediction accuracy compared with the state-of-the-art FEM-based approach with significantly improved computational efficiency.

📄 PDF Abstract BibTeX arXiv:2210.01685

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Methods 이 논문이 사용한 방법론

FEM 설명 없음

Similar Papers 제목 키워드 기반

Soft-tissue Driven Craniomaxillofacial Surgical Planning

2023-07-20 · Xi Fang, Daeseung Kim, Xuanang Xu, Tianshu Kuang 외

In CMF surgery, the planning of bony movement to achieve a desired facial outcome is a challenging task. Current bone driven approaches focus on normalizing the bone with the expectation that the facial appearance will b…

Nonparametric Context Modeling of Local Appearance for Pose- and Expression-Robust Facial Landmark Localization

2014-06-01 · CVPR 2014 6 · Brandon M. Smith, Jonathan Brandt, Zhe Lin, Li Zhang

We propose a data-driven approach to facial landmark localization that models the correlations between each landmark and its surrounding appearance features. At runtime, each feature casts a weighted vote to predict land…

Face Alignment

AI killed the video star. Audio-driven diffusion model for expressive talking head generation

2025-11-27 · Baptiste Chopin, Tashvik Dhamija, Pranav Balaji, Yaohui Wang 외 arxiv

We propose Dimitra++, a novel framework for audio-driven talking head generation, streamlined to learn lip motion, facial expression, as well as head pose motion. Specifically, we propose a conditional Motion Diffusion T…

Talking Head Generation

Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360°

2024-08-01 · Yuxiao He, Yiyu Zhuang, Yanwen Wang, Yao Yao 외

Creating a 360{\deg} parametric model of a human head is a very challenging task. While recent advancements have demonstrated the efficacy of leveraging synthetic data for building such parametric head models, their perf…

FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation Synthesis

2019-11-21 · Kuangxiao Gu, Yuqian Zhou, Thomas Huang

Talking face synthesis has been widely studied in either appearance-based or warping-based methods. Previous works mostly utilize single face image as a source, and generate novel facial animations by merging other perso…

Face Generation