paper-with-me

홈 › Papers

HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors

2024-06-18 · Panwang Pan, Zhuo Su, Chenguo Lin, Zhen Fan, YongJie Zhang, Zeming Li, Tingting Shen, Yadong Mu, Yebin Liu

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle these issues, we present HumanSplat which predicts the 3D Gaussian Splatting properties of any human from a single input image in a generalizable manner. In particular, HumanSplat comprises a 2D multi-view diffusion model and a latent reconstruction transformer with human structure priors that adeptly integrate geometric priors and semantic features within a unified framework. A hierarchical loss that incorporates human semantic information is further designed to achieve high-fidelity texture modeling and better constrain the estimated multiple views. Comprehensive experiments on standard benchmarks and in-the-wild images demonstrate that HumanSplat surpasses existing state-of-the-art methods in achieving photorealistic novel-view synthesis.

📄 PDF Abstract BibTeX arXiv:2406.12459

Code (1)

humansplat/humansplat.github.io 공식 구현

Tasks

Novel View Synthesis

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

HumanSplatHMR: Closing the Loop Between Human Mesh Recovery and Gaussian Splatting Avatar

2026-05-04 · Yeheng Zong, Pou-Chun Kung, Yike Pan, Seth Isaacson 외 arxiv

Accurately recovering human pose and appearance from video is an essential component of scene reconstruction, with applications to motion capture, motion prediction, virtual reality, and digital twinning. Despite signifi…

Human Mesh RecoveryPose Estimation

Generalizable Human Gaussians from Single-View Image

2024-06-10 · Jinnan Chen, Chen Li, Jianfeng Zhang, Lingting Zhu 외

In this work, we tackle the task of learning 3D human Gaussians from a single image, focusing on recovering detailed appearance and geometry including unobserved regions. We introduce a single-view generalizable Human Ga…

Novel View SynthesisSSIMSurface Reconstruction

HuGDiffusion: Generalizable Single-Image Human Rendering via 3D Gaussian Diffusion

2025-01-25 · Yingzhi Tang, Qijian Zhang, Junhui Hou

We present HuGDiffusion, a generalizable 3D Gaussian splatting (3DGS) learning pipeline to achieve novel view synthesis (NVS) of human characters from single-view input images. Existing approaches typically require monoc…

3DGSAttributeNovel View Synthesis

HFGaussian: Learning Generalizable Gaussian Human with Integrated Human Features

2024-11-05 · Arnab Dey, Cheng-You Lu, Andrew I. Comport, Srinath Sridhar 외

Recent advancements in radiance field rendering show promising results in 3D scene representation, where Gaussian splatting-based techniques emerge as state-of-the-art due to their quality and efficiency. Gaussian splatt…

Feature SplattingPose Estimation

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

2024-12-17 · Wonseok Roh, Hwanhee Jung, Jong Wook Kim, Seunggwan Lee 외

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance fie…

3D Scene ReconstructionNovel View Synthesis