paper-with-me

홈 › Papers

MV-TON: Memory-based Video Virtual Try-on network

2021-08-17 · Xiaojing Zhong, Zhonghua Wu, Taizhe Tan, Guosheng Lin, Qingyao Wu

With the development of Generative Adversarial Network, image-based virtual try-on methods have made great progress. However, limited work has explored the task of video-based virtual try-on while it is important in real-world applications. Most existing video-based virtual try-on methods usually require clothing templates and they can only generate blurred and low-resolution results. To address these challenges, we propose a Memory-based Video virtual Try-On Network (MV-TON), which seamlessly transfers desired clothes to a target person without using any clothing templates and generates high-resolution realistic videos. Specifically, MV-TON consists of two modules: 1) a try-on module that transfers the desired clothes from model images to frame images by pose alignment and region-wise replacing of pixels; 2) a memory refinement module that learns to embed the existing generated frames into the latent space as external memory for the following frame generation. Experimental results show the effectiveness of our method in the video virtual try-on task and its superiority over other existing methods.

📄 PDF Abstract BibTeX arXiv:2108.07502

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkVirtual Try-on

Similar Papers 제목 키워드 기반

ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on

2020-12-18 · Gaurav Kuppa, Andrew Jong, Vera Liu, Ziwei Liu 외

Virtual try-on has garnered interest as a neural rendering benchmark task to evaluate complex object transfer and scene composition. Recent works in virtual clothing try-on feature a plethora of possible architectural an…

Neural RenderingVirtual Try-on

MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy

2023-11-07 · Łukasz Struski, Tomasz Urbańczyk, Krzysztof Bucki, Bartłomiej Cupiał 외

Video generation is important, especially in medicine, as much data is given in this form. However, video generation of high-resolution data is a very demanding task for generative models, due to the large need for memor…

Generative Adversarial NetworkMedical ProcedureVideo Generation

Language-Driven Interactive Shadow Detection

2024-08-16 · Hongqiu Wang, Wei Wang, Haipeng Zhou, Huihui Xu 외

Traditional shadow detectors often identify all shadow regions of static images or video sequences. This work presents the Referring Video Shadow Detection (RVSD), which is an innovative task that rejuvenates the classic…

DescriptiveShadow DetectionVideo EditingVideo Shadow Detection

LiveVVT: High-Fidelity Video Virtual Try-On in Real Time

2026-08-27 · Yushe Cao, Shikun Feng, Ruxiang Duan, Liyong Wang 외 arxiv

Diffusion-based Video Virtual Try-On (VVT) achieves high visual fidelity through bidirectional spatio-temporal modeling, but complete-clip dependence incurs prohibitive latency and computational overhead in practical con…

Virtual Try-on

Fashion-VDM: Video Diffusion Model for Virtual Try-On

2024-10-31 · Johanna Karras, Yingwei Li, Nan Liu, Luyang Zhu 외

We present Fashion-VDM, a video diffusion model (VDM) for generating virtual try-on videos. Given an input garment image and person video, our method aims to generate a high-quality try-on video of the person wearing the…

Video GenerationVirtual Try-on