paper-with-me

홈 › Papers

Complete 3D Human Reconstruction From a Single Incomplete Image

2023-01-01 · CVPR 2023 1 · Junying Wang, Jae Shin Yoon, Tuanfeng Y. Wang, Krishna Kumar Singh, Ulrich Neumann

This paper presents a method to reconstruct a complete human geometry and texture from an image of a person with only partial body observed, e.g., a torso. The core challenge arises from the occlusion: there exists no pixel to reconstruct where many existing single-view human reconstruction methods are not designed to handle such invisible parts, leading to missing data in 3D. To address this challenge, we introduce a novel coarse-to-fine human reconstruction framework. For coarse reconstruction, explicit volumetric features are learned to generate a complete human geometry with 3D convolutional neural networks conditioned by a 3D body model and the style features from visible parts. An implicit network combines the learned 3D features with the high-quality surface normals enhanced from multiview to produce fine local details, e.g., high-frequency wrinkles. Finally, we perform progressive texture inpainting to reconstruct a complete appearance of the person in a view-consistent way, which is not possible without the reconstruction of a complete geometry. In experiments, we demonstrate that our method can reconstruct high-quality 3D humans, which is robust to occlusion.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Reconstruction

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

3D Brain Reconstruction by Hierarchical Shape-Perception Network from a Single Incomplete Image

2021-07-23 · Bowen Hu, Baiying Lei, Shuqiang Wang, Yong liu 외

3D shape reconstruction is essential in the navigation of minimally-invasive and auto robot-guided surgeries whose operating environments are indirect and narrow, and there have been some works that focused on reconstruc…

3D Shape Reconstruction

Prompted Contextual Transformer for Incomplete-View CT Reconstruction

2023-12-13 · Chenglong Ma, Zilong Li, Junjun He, Junping Zhang 외

Incomplete-view computed tomography (CT) can shorten the data acquisition time and allow scanning of large objects, including sparse-view and limited-angle scenarios, each with various settings, such as different view nu…

Computed Tomography (CT)CT Reconstruction

DreaMo: Articulated 3D Reconstruction From A Single Casual Video

2023-12-05 · Tao Tu, Ming-Feng Li, Chieh Hubert Lin, Yen-Chi Cheng 외

Articulated 3D reconstruction has valuable applications in various domains, yet it remains costly and demands intensive work from domain experts. Recent advancements in template-free learning methods show promising resul…

3D Reconstruction3D Shape Reconstruction

Self-Attention Generative Adversarial Network for Iterative Reconstruction of CT Images

2021-12-23 · Ruiwen Xing, Thomas Humphries, Dong Si

Computed tomography (CT) uses X-ray measurements taken from sensors around the body to generate tomographic images of the human body. Conventional reconstruction algorithms can be used if the X-ray data are adequately sa…

Computed Tomography (CT)DenoisingGenerative Adversarial NetworkImage Reconstruction

SinGS: Animatable Single-Image Human Gaussian Splats with Kinematic Priors

2025-01-01 · CVPR 2025 1 · Yufan Wu, Xuanhong Chen, Wen Li, Shunran Jia 외

Despite significant advances in accurately estimating geometry in contemporary single-image 3D human reconstruction, creating a high-quality, efficient, and animatable 3D avatar remains an open challenge. Two key ob…

3D Human Reconstruction