3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On
Image-based virtual try-on (VTON) approaches are getting attention since they do not require 3D modeling. However, 2D cloth warping algorithms cannot cover 3D spatial transformations for diverse target human poses. To solve this problem, we propose a 2D and 3D hybrid method. First, a 3D clothing mesh is reconstructed leveraging a 3D human body model in a rest pose. Due to the correspondence, resulting 3D clothing models can be easily transferred to the target human models with different poses and shapes estimated from 2D images. Finally, the deformed clothing models can be rendered and blended with target human representations. Experimental results with an open dataset show that shapes of reconstructed clothing are more natural, compared to the 2D image-based deformation results, when human poses and shapes are estimated accurately.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionVirtual Try-onSimilar Papers 제목 키워드 기반
USR: Unsupervised Separated 3D Garment and Human Reconstruction via Geometry and Semantic Consistency
Dressed people reconstruction from images is a popular task with promising applications in the creative media and game industry. However, most existing methods reconstruct the human body and garments as a whole with the …
3D geometryVirtual Try-onRealistic, Animatable Human Reconstructions for Virtual Fit-On
We present an end-to-end virtual try-on pipeline, that can fit different clothes on a personalized 3-D human model, reconstructed using a single RGB image. Our main idea is to construct an animatable 3-D human model and …
Virtual Try-onRepresenting a Partially Observed Non-Rigid 3D Human Using Eigen-Texture and Eigen-Deformation
Reconstruction of the shape and motion of humans from RGB-D is a challenging problem, receiving much attention in recent years. Recent approaches for full-body reconstruction use a statistic shape model, which is built u…
Single-view 3D Body and Cloth Reconstruction under Complex Poses
Recent advances in 3D human shape reconstruction from single images have shown impressive results, leveraging on deep networks that model the so-called implicit function to learn the occupancy status of arbitrarily dense…
3D ReconstructionNormal-guided Garment UV Prediction for Human Re-texturing
Clothes undergo complex geometric deformations, which lead to appearance changes. To edit human videos in a physically plausible way, a texture map must take into account not only the garment transformation induced by th…
3D ReconstructionPrediction