paper-with-me

Papers

FAGhead: Fully Animate Gaussian Head from Monocular Videos

2024-06-27 · Yixin Xuan, Xinyang Li, Gongxin Yao, Shiwei Zhou, Donghui Sun, Xiaoxin Chen, Yu Pan

High-fidelity reconstruction of 3D human avatars has a wild application in visual reality. In this paper, we introduce FAGhead, a method that enables fully controllable human portraits from monocular videos. We explicit the traditional 3D morphable meshes (3DMM) and optimize the neutral 3D Gaussians to reconstruct with complex expressions. Furthermore, we employ a novel Point-based Learnable Representation Field (PLRF) with learnable Gaussian point positions to enhance reconstruction performance. Meanwhile, to effectively manage the edges of avatars, we introduced the alpha rendering to supervise the alpha value of each pixel. Extensive experimental results on the open-source datasets and our capturing datasets demonstrate that our approach is able to generate high-fidelity 3D head avatars and fully control the expression and pose of the virtual avatars, which is outperforming than existing works.

📄 PDF Abstract BibTeX arXiv:2406.19070

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar

2023-12-07 · Yufan Chen, Lizhen Wang, Qijing Li, Hongjiang Xiao 외

The ability to animate photo-realistic head avatars reconstructed from monocular portrait video sequences represents a crucial step in bridging the gap between the virtual and real worlds. Recent advancements in head ava…

DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video

2026-03-30 · Jeonghaeng Lee, Seok Keun Choi, Zhixuan Li, Weisi Lin 외 arxiv

While recent 3D head avatar creation methods attempt to animate facial dynamics, they often fail to capture personalized details, limiting realism and expressiveness. To fill this gap, we present DipGuava (Disentangled a…

GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction

2024-07-21 · Yuelang Xu, Zhaoqi Su, Qingyao Wu, Yebin Liu

Creating high-fidelity 3D human head avatars is crucial for applications in VR/AR, digital human, and film production. Recent advances have leveraged morphable face models to generate animated head avatars from easily ac…

SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussians

2025-04-16 · Liam Schoneveld, Zhe Chen, Davide Davoli, Jiapeng Tang 외

Accurate, real-time 3D reconstruction of human heads from monocular images and videos underlies numerous visual applications. As 3D ground truth data is hard to come by at scale, previous methods have sought to learn fro…

3D ReconstructionEmotion Classification

InteractAvatar: Modeling Hand-Face Interaction in Photorealistic Avatars with Deformable Gaussians

2025-04-10 · Kefan Chen, Sergiu Oprea, Justin Theiss, Sreyas Mohan 외

With the rising interest from the community in digital avatars coupled with the importance of expressions and gestures in communication, modeling natural avatar behavior remains an important challenge across many industr…

Novel View Synthesis