paper-with-me

홈 › Papers

A Novel Garment Transfer Method Supervised by Distilled Knowledge of Virtual Try-on Model

2024-01-23 · Naiyu Fang, Lemiao Qiu, Shuyou Zhang, Zili Wang, Kerui Hu, Jianrong Tan

This paper proposes a novel garment transfer method supervised with knowledge distillation from virtual try-on. Our method first reasons the transfer parsing to provide shape prior to downstream tasks. We employ a multi-phase teaching strategy to supervise the training of the transfer parsing reasoning model, learning the response and feature knowledge from the try-on parsing reasoning model. To correct the teaching error, it transfers the garment back to its owner to absorb the hard knowledge in the self-study phase. Guided by the transfer parsing, we adjust the position of the transferred garment via STN to prevent distortion. Afterward, we estimate a progressive flow to precisely warp the garment with shape and content correspondences. To ensure warping rationality, we supervise the training of the garment warping model using target shape and warping knowledge from virtual try-on. To better preserve body features in the transfer result, we propose a well-designed training strategy for the arm regrowth task to infer new exposure skin. Experiments demonstrate that our method has state-of-the-art performance compared with other virtual try-on and garment transfer methods in garment transfer, especially for preserving garment texture and body features.

📄 PDF Abstract BibTeX arXiv:2401.12433

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementKnowledge DistillationPose TransferSelf-Supervised LearningVirtual Try-on

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN

2021-11-20 · NeurIPS 2021 12 · Zhenyu Xie, Zaiyu Huang, Fuwei Zhao, Haoye Dong 외

Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. Yet, as most try-on approaches fit in-shop garments onto a target person,…

DisentanglementImage GenerationVirtual Try-on

Greatness in Simplicity: Unified Self-Cycle Consistency for Parser-Free Virtual Try-On

2023-09-21 · NeurIPS 2023 11

Image-based virtual try-on tasks remain challenging, primarily due to inherent complexities associated with non-rigid garment deformation modeling and strong feature entanglement of clothing within human body. Recent gro…

Dressing in the Wild by Watching Dance Videos

2022-03-29 · CVPR 2022 1 · Xin Dong, Fuwei Zhao, Zhenyu Xie, Xijin Zhang 외

While significant progress has been made in garment transfer, one of the most applicable directions of human-centric image generation, existing works overlook the in-the-wild imagery, presenting severe garment-person mis…

Image GenerationVirtual Try-on

Two-Way Garment Transfer: Unified Diffusion Framework for Dressing and Undressing Synthesis

2025-08-06 · Angang Zhang, Fang Deng, Hao Chen, Zhongjian Chen 외 arxiv

While recent advances in virtual try-on (VTON) have achieved realistic garment transfer to human subjects, its inverse task, virtual try-off (VTOFF), which aims to reconstruct canonical garment templates from dressed hum…

Virtual Try-OffVirtual Try-on

Controllable Garment Transfer

2022-04-05 · Jooeun Son, Tomas Cabezon Pedroso, Carolene Siga, Jinsung Lee

Image-based garment transfer replaces the garment on the target human with the desired garment; this enables users to virtually view themselves in the desired garment. To this end, many approaches have been proposed usin…