paper-with-me

홈 › Papers

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering

2023-12-10 · CVPR 2024 1 · Haokai Pang, Heming Zhu, Adam Kortylewski, Christian Theobalt, Marc Habermann

Real-time rendering of photorealistic and controllable human avatars stands as a cornerstone in Computer Vision and Graphics. While recent advances in neural implicit rendering have unlocked unprecedented photorealism for digital avatars, real-time performance has mostly been demonstrated for static scenes only. To address this, we propose ASH, an animatable Gaussian splatting approach for photorealistic rendering of dynamic humans in real-time. We parameterize the clothed human as animatable 3D Gaussians, which can be efficiently splatted into image space to generate the final rendering. However, naively learning the Gaussian parameters in 3D space poses a severe challenge in terms of compute. Instead, we attach the Gaussians onto a deformable character model, and learn their parameters in 2D texture space, which allows leveraging efficient 2D convolutional architectures that easily scale with the required number of Gaussians. We benchmark ASH with competing methods on pose-controllable avatars, demonstrating that our method outperforms existing real-time methods by a large margin and shows comparable or even better results than offline methods.

📄 PDF Abstract BibTeX arXiv:2312.05941

Code (1)

kv2000/ASH 공식 구현 pytorch

Similar Papers 제목 키워드 기반

HUGS: Human Gaussian Splats

2023-11-29 · CVPR 2024 1 · Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel 외

Recent advances in neural rendering have improved both training and rendering times by orders of magnitude. While these methods demonstrate state-of-the-art quality and speed, they are designed for photogrammetry of stat…

3DGSNeural RenderingNovel View Synthesis

iHuman: Instant Animatable Digital Humans From Monocular Videos

2024-07-15 · Pramish Paudel, Anubhav Khanal, Ajad Chhatkuli, Danda Pani Paudel 외

Personalized 3D avatars require an animatable representation of digital humans. Doing so instantly from monocular videos offers scalability to broad class of users and wide-scale applications. In this paper, we present a…

3D geometry3D Reconstruction

GaussianGAN: Real-Time Photorealistic controllable Human Avatars

2025-09-01 · Mohamed Ilyes Lakhal, Richard Bowden arxiv

Photorealistic and controllable human avatars have gained popularity in the research community thanks to rapid advances in neural rendering, providing fast and realistic synthesis tools. However, a limitation of current …

Semantic Segmentation

GeoTexDensifier: Geometry-Texture-Aware Densification for High-Quality Photorealistic 3D Gaussian Splatting

2024-12-22 · Hanqing Jiang, Xiaojun Xiang, Han Sun, Hongjie Li 외

3D Gaussian Splatting (3DGS) has recently attracted wide attentions in various areas such as 3D navigation, Virtual Reality (VR) and 3D simulation, due to its photorealistic and efficient rendering performance. High-qual…

3DGSNovel View Synthesis

SplatSim: Zero-Shot Sim2Real Transfer of RGB Manipulation Policies Using Gaussian Splatting

2024-09-16 · Mohammad Nomaan Qureshi, Sparsh Garg, Francisco Yandun, David Held 외

Sim2Real transfer, particularly for manipulation policies relying on RGB images, remains a critical challenge in robotics due to the significant domain shift between synthetic and real-world visual data. In this paper, w…