Complete 3D Human Reconstruction From a Single Incomplete Image
This paper presents a method to reconstruct a complete human geometry and texture from an image of a person with only partial body observed, e.g., a torso. The core challenge arises from the occlusion: there exists no pixel to reconstruct where many existing single-view human reconstruction methods are not designed to handle such invisible parts, leading to missing data in 3D. To address this challenge, we introduce a novel coarse-to-fine human reconstruction framework. For coarse reconstruction, explicit volumetric features are learned to generate a complete human geometry with 3D convolutional neural networks conditioned by a 3D body model and the style features from visible parts. An implicit network combines the learned 3D features with the high-quality surface normals enhanced from multiview to produce fine local details, e.g., high-frequency wrinkles. Finally, we perform progressive texture inpainting to reconstruct a complete appearance of the person in a view-consistent way, which is not possible without the reconstruction of a complete geometry. In experiments, we demonstrate that our method can reconstruct high-quality 3D humans, which is robust to occlusion.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
3D Brain Reconstruction by Hierarchical Shape-Perception Network from a Single Incomplete Image
3D shape reconstruction is essential in the navigation of minimally-invasive and auto robot-guided surgeries whose operating environments are indirect and narrow, and there have been some works that focused on reconstruc…
3D Shape ReconstructionPrompted Contextual Transformer for Incomplete-View CT Reconstruction
Incomplete-view computed tomography (CT) can shorten the data acquisition time and allow scanning of large objects, including sparse-view and limited-angle scenarios, each with various settings, such as different view nu…
Computed Tomography (CT)CT ReconstructionDreaMo: Articulated 3D Reconstruction From A Single Casual Video
Articulated 3D reconstruction has valuable applications in various domains, yet it remains costly and demands intensive work from domain experts. Recent advancements in template-free learning methods show promising resul…
3D Reconstruction3D Shape ReconstructionSelf-Attention Generative Adversarial Network for Iterative Reconstruction of CT Images
Computed tomography (CT) uses X-ray measurements taken from sensors around the body to generate tomographic images of the human body. Conventional reconstruction algorithms can be used if the X-ray data are adequately sa…
Computed Tomography (CT)DenoisingGenerative Adversarial NetworkImage ReconstructionSinGS: Animatable Single-Image Human Gaussian Splats with Kinematic Priors
Despite significant advances in accurately estimating geometry in contemporary single-image 3D human reconstruction, creating a high-quality, efficient, and animatable 3D avatar remains an open challenge. Two key ob…
3D Human Reconstruction