paper-with-me

홈 › Papers

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars

2023-11-27 · Yang Liu, Xiang Huang, Minghan Qin, Qinwei Lin, Haoqian Wang

Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render and not suitable for multi-human scenes with complex shadows. To reduce consumption, we propose Animatable 3D Gaussian, which learns human avatars from input images and poses. We extend 3D Gaussians to dynamic human scenes by modeling a set of skinned 3D Gaussians and a corresponding skeleton in canonical space and deforming 3D Gaussians to posed space according to the input poses. We introduce a multi-head hash encoder for pose-dependent shape and appearance and a time-dependent ambient occlusion module to achieve high-quality reconstructions in scenes containing complex motions and dynamic shadows. On both novel view synthesis and novel pose synthesis tasks, our method achieves higher reconstruction quality than InstantAvatar with less training time (1/60), less GPU memory (1/4), and faster rendering speed (7x). Our method can be easily extended to multi-human scenes and achieve comparable novel view synthesis results on a scene with ten people in only 25 seconds of training.

📄 PDF Abstract BibTeX arXiv:2311.16482

Code (1)

jimmyYliu/Animatable-3D-Gaussian 공식 구현

Tasks

GPUNovel View Synthesis

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

GUAVA: Generalizable Upper Body 3D Gaussian Avatar

2025-05-06 · Dongbin Zhang, Yunfei Liu, Lijian Lin, Ye Zhu 외

Reconstructing a high-quality, animatable 3D human avatar with expressive facial and hand motions from a single image has gained significant attention due to its broad application potential. 3D human avatar reconstructio…

SinGS: Animatable Single-Image Human Gaussian Splats with Kinematic Priors

2025-01-01 · CVPR 2025 1 · Yufan Wu, Xuanhong Chen, Wen Li, Shunran Jia 외

Despite significant advances in accurately estimating geometry in contemporary single-image 3D human reconstruction, creating a high-quality, efficient, and animatable 3D avatar remains an open challenge. Two key ob…

3D Human Reconstruction

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

2023-12-14 · CVPR 2024 1 · Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger 외

We introduce an approach that creates animatable human avatars from monocular videos using 3D Gaussian Splatting (3DGS). Existing methods based on neural radiance fields (NeRFs) achieve high-quality novel-view/novel-pose…

3DGSImage Generation

Generalizable and Animatable Gaussian Head Avatar

2024-10-10 · Xuangeng Chu, Tatsuya Harada

In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering cons…

LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh

2025-02-13 · Jing Wen, Alexander G. Schwing, Shenlong Wang

Generalizable rendering of an animatable human avatar from sparse inputs relies on data priors and inductive biases extracted from training on large data to avoid scene-specific optimization and to enable fast reconstruc…