paper-with-me

홈 › Papers

InstantAvatar: Efficient 3D Head Reconstruction via Surface Rendering

2023-08-09 · Antonio Canela, Pol Caselles, Ibrar Malik, Eduard Ramon, Jaime García, Jordi Sánchez-Riera, Gil Triginer, Francesc Moreno-Noguer

Recent advances in full-head reconstruction have been obtained by optimizing a neural field through differentiable surface or volume rendering to represent a single scene. While these techniques achieve an unprecedented accuracy, they take several minutes, or even hours, due to the expensive optimization process required. In this work, we introduce InstantAvatar, a method that recovers full-head avatars from few images (down to just one) in a few seconds on commodity hardware. In order to speed up the reconstruction process, we propose a system that combines, for the first time, a voxel-grid neural field representation with a surface renderer. Notably, a naive combination of these two techniques leads to unstable optimizations that do not converge to valid solutions. In order to overcome this limitation, we present a novel statistical model that learns a prior distribution over 3D head signed distance functions using a voxel-grid based architecture. The use of this prior model, in combination with other design choices, results into a system that achieves 3D head reconstructions with comparable accuracy as the state-of-the-art with a 100x speed-up.

📄 PDF Abstract BibTeX arXiv:2308.04868

Code (0)

등록된 구현이 없습니다.

Tasks

valid

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds

2022-12-20 · CVPR 2023 1 · Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges

In this paper, we take a significant step towards real-world applicability of monocular neural avatar reconstruction by contributing InstantAvatar, a system that can reconstruct human avatars from a monocular video withi…

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars

2023-11-27 · Yang Liu, Xiang Huang, Minghan Qin, Qinwei Lin 외

Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render and not suitable for multi-human scenes with complex shadows. To reduce consumption, we propo…

GPUNovel View Synthesis

SVG-Head: Hybrid Surface-Volumetric Gaussians for High-Fidelity Head Reconstruction and Real-Time Editing

2025-08-13 · Heyi Sun, Cong Wang, Tian-Xing Xu, Jingwei Huang 외 arxiv

Creating high-fidelity and editable head avatars is a pivotal challenge in computer vision and graphics, boosting many AR/VR applications. While recent advancements have achieved photorealistic renderings and plausible a…

SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatars

2024-10-15 · Jaeseong Lee, Taewoong Kang, Marcel C. Bühler, Min-Jung Kim 외

Recent advancements in head avatar rendering using Gaussian primitives have achieved significantly high-fidelity results. Although precise head geometry is crucial for applications like mesh reconstruction and relighting…

GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstruction

2026-02-27 · Chao Xu, Xiaochen Zhao, Xiang Deng, Jingxiang Sun 외 arxiv

Reconstructing photorealistic and animatable 4D head avatars from a single portrait image remains a fundamental challenge in computer vision. While diffusion models have enabled remarkable progress in image and video gen…

Video Generation