paper-with-me

Papers

Towards a complete 3D morphable model of the human head

2019-11-18 · Stylianos Ploumpis, Evangelos Ververas, Eimear O' Sullivan, Stylianos Moschoglou, Haoyang Wang, Nick Pears, William A. P. Smith, Baris Gecer, Stefanos Zafeiriou

Three-dimensional Morphable Models (3DMMs) are powerful statistical tools for representing the 3D shapes and textures of an object class. Here we present the most complete 3DMM of the human head to date that includes face, cranium, ears, eyes, teeth and tongue. To achieve this, we propose two methods for combining existing 3DMMs of different overlapping head parts: i. use a regressor to complete missing parts of one model using the other, ii. use the Gaussian Process framework to blend covariance matrices from multiple models. Thus we build a new combined face-and-head shape model that blends the variability and facial detail of an existing face model (the LSFM) with the full head modelling capability of an existing head model (the LYHM). Then we construct and fuse a highly-detailed ear model to extend the variation of the ear shape. Eye and eye region models are incorporated into the head model, along with basic models of the teeth, tongue and inner mouth cavity. The new model achieves state-of-the-art performance. We use our model to reconstruct full head representations from single, unconstrained images allowing us to parameterize craniofacial shape and texture, along with the ear shape, eye gaze and eye color.

📄 PDF Abstract BibTeX arXiv:1911.08008

Code (1)

steliosploumpis/Universal_Head_3DMM 공식 구현

Tasks

Face Model

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

2020-11-28 · CVPR 2021 1 · Tarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel 외

We present the first deep implicit 3D morphable model (i3DMM) of full heads. Unlike earlier morphable face models it not only captures identity-specific geometry, texture, and expressions of the frontal face, but also mo…

Text2Face: A Multi-Modal 3D Face Model

2023-03-05 · Will Rowan, Patrik Huber, Nick Pears, Andrew Keeling

We present the first 3D morphable modelling approach, whereby 3D face shape can be directly and completely defined using a textual prompt. Building on work in multi-modal learning, we extend the FLAME head model to a com…

Face Modelmodel

Learning Neural Parametric Head Models

2022-12-06 · CVPR 2023 1 · Simon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz 외

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent…

I M Avatar: Implicit Morphable Head Avatars from Videos

2021-12-14 · CVPR 2022 1 · Yufeng Zheng, Victoria Fernández Abrevaya, Marcel C. Bühler, Xu Chen 외

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard t…

MORPH

Neural Head Avatars from Monocular RGB Videos

2021-12-02 · CVPR 2022 1 · Philip-William Grassal, Malte Prinzler, Titus Leistner, Carsten Rother 외

We present Neural Head Avatars, a novel neural representation that explicitly models the surface geometry and appearance of an animatable human avatar that can be used for teleconferencing in AR/VR or other applications …

Novel View Synthesis