paper-with-me

홈 › Papers

BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors

2024-03-18 · Tingyang Zhang, Qingzhe Gao, Weiyu Li, Libin Liu, Baoquan Chen

Animatable 3D reconstruction has significant applications across various fields, primarily relying on artists' handcraft creation. Recently, some studies have successfully constructed animatable 3D models from monocular videos. However, these approaches require sufficient view coverage of the object within the input video and typically necessitate significant time and computational costs for training and rendering. This limitation restricts the practical applications. In this work, we propose a method to build animatable 3D Gaussian Splatting from monocular video with diffusion priors. The 3D Gaussian representations significantly accelerate the training and rendering process, and the diffusion priors allow the method to learn 3D models with limited viewpoints. We also present the rigid regularization to enhance the utilization of the priors. We perform an extensive evaluation across various real-world videos, demonstrating its superior performance compared to the current state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2403.11427

Code (0)

등록된 구현이 없습니다.

Tasks

3D Reconstruction

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

2023-12-14 · CVPR 2024 1 · Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger 외

We introduce an approach that creates animatable human avatars from monocular videos using 3D Gaussian Splatting (3DGS). Existing methods based on neural radiance fields (NeRFs) achieve high-quality novel-view/novel-pose…

3DGSImage Generation

2DGS-Avatar: Animatable High-fidelity Clothed Avatar via 2D Gaussian Splatting

2025-03-04 · Qipeng Yan, Mingyang Sun, Lihua Zhang

Real-time rendering of high-fidelity and animatable avatars from monocular videos remains a challenging problem in computer vision and graphics. Over the past few years, the Neural Radiance Field (NeRF) has made signific…

3DGSNeRF

HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatars

2025-07-03 · Gent Serifi, Marcel C. Buehler arxiv

We introduce HyperGaussians, a novel extension of 3D Gaussian Splatting for high-quality animatable face avatars. Creating such detailed face avatars from videos is a challenging problem and has numerous applications in …

GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh

2024-04-11 · CVPR 2024 1 · Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing 외

We introduce GoMAvatar, a novel approach for real-time, memory-efficient, high-quality animatable human modeling. GoMAvatar takes as input a single monocular video to create a digital avatar capable of re-articulation in…

Computational Efficiency

iHuman: Instant Animatable Digital Humans From Monocular Videos

2024-07-15 · Pramish Paudel, Anubhav Khanal, Ajad Chhatkuli, Danda Pani Paudel 외

Personalized 3D avatars require an animatable representation of digital humans. Doing so instantly from monocular videos offers scalability to broad class of users and wide-scale applications. In this paper, we present a…

3D geometry3D Reconstruction