CloTH-VTON: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON
Virtual clothing try-on, transferring a clothing image onto a target person image, is drawing industrial and research attention. Both 2D image-based and 3D model-based methods proposed recently have their benefits and limitations. Whereas 3D model-based methods provide realistic deformations of the clothing, it needs a difficult 3D model construction process and cannot handle the non-clothing areas well. Image-based deep neural network methods are good at generating disclosed human parts, retaining the unchanged area, and blending image parts, but cannot handle large deformation of clothing. In this paper, we propose CloTH-VTON that utilizes the high-quality image synthesis of 2D image-based methods and the 3D model-based deformation to the target human pose. For this 2D and 3D combination, we propose a novel 3D cloth reconstruction method from a single 2D cloth image, leveraging a 3D human body model, and transfer to the shape and pose of the target person. Our cloth reconstruction method can be easily applied to diverse cloth categories. Our method produces final try-on output with naturally deformed clothing and preserving details in high resolution.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationVirtual Try-onSimilar Papers 제목 키워드 기반
CloTH-VTON+: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON
Image-based virtual try-on (VTON) systems based on deep learning have attracted research and commercialinterests. Although they show their strengths in blending the person and try-on clothing image andsynthesizing the di…
Pose EstimationVirtual Try-onCP-VTON+: Clothing Shape and Texture Preserving Image-Based Virtual Try-On
Recently proposed Image-based virtual try-on (VTON) approaches have several challenges regarding diverse human poses and cloth styles. First, clothing warping networks often generate highly distorted and misaligned warpe…
Virtual Try-onShape-Guided Clothing Warping for Virtual Try-On
Image-based virtual try-on aims to seamlessly fit in-shop clothing to a person image while maintaining pose consistency. Existing methods commonly employ the thin plate spline (TPS) transformation or appearance flow to d…
Virtual Try-onMV-VTON: Multi-View Virtual Try-On with Diffusion Models
The goal of image-based virtual try-on is to generate an image of the target person naturally wearing the given clothing. However, existing methods solely focus on the frontal try-on using the frontal clothing. When the …
Virtual Try-onSignificance of Anatomical Constraints in Virtual Try-On
The system of Virtual Try-ON (VTON) allows a user to try a product virtually. In general, a VTON system takes a clothing source and a person's image to predict the try-on output of the person in the given clothing. Altho…
AnatomyVirtual Try-on