paper-with-me

Papers

Learning Neural Parametric Head Models

2022-12-06 · CVPR 2023 1 · Simon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz, Lourdes Agapito, Matthias Nießner

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this end, we capture a person's identity in a canonical space as a signed distance field (SDF), and model facial expressions with a neural deformation field. In addition, our representation achieves high-fidelity local detail by introducing an ensemble of local fields centered around facial anchor points. To facilitate generalization, we train our model on a newly-captured dataset of over 5200 head scans from 255 different identities using a custom high-end 3D scanning setup. Our dataset significantly exceeds comparable existing datasets, both with respect to quality and completeness of geometry, averaging around 3.5M mesh faces per scan. Finally, we demonstrate that our approach outperforms state-of-the-art methods in terms of fitting error and reconstruction quality.

📄 PDF Abstract BibTeX arXiv:2212.02761

Code (1)

simongiebenhain/nphm pytorch

Similar Papers 제목 키워드 기반

Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360°

2024-08-01 · Yuxiao He, Yiyu Zhuang, Yanwen Wang, Yao Yao 외

Creating a 360{\deg} parametric model of a human head is a very challenging task. While recent advancements have demonstrated the efficacy of leveraging synthetic data for building such parametric head models, their perf…

HeadNeRF: A Real-time NeRF-based Parametric Head Model

2021-12-10 · CVPR 2022 1 · Yang Hong, Bo Peng, Haiyao Xiao, Ligang Liu 외

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-t…

NeRFNeural Rendering

GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction

2024-07-21 · Yuelang Xu, Zhaoqi Su, Qingyao Wu, Yebin Liu

Creating high-fidelity 3D human head avatars is crucial for applications in VR/AR, digital human, and film production. Recent advances have leveraged morphable face models to generate animated head avatars from easily ac…

Taming Knowledge Conflicts in Language Models

2025-03-14 · Gaotang Li, Yuzhong Chen, Hanghang Tong

Language Models (LMs) often encounter knowledge conflicts when parametric memory contradicts contextual knowledge. Previous works attribute this conflict to the interplay between "memory heads" and "context heads", atten…

Attribute

FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models

2023-12-13 · CVPR 2024 1 · Shivangi Aneja, Justus Thies, Angela Dai, Matthias Nießner

We introduce FaceTalk, a novel generative approach designed for synthesizing high-fidelity 3D motion sequences of talking human heads from input audio signal. To capture the expressive, detailed nature of human heads, in…

3D Face AnimationAudio SynthesisMotion Synthesis