paper-with-me

홈 › Papers

Fashion-VDM: Video Diffusion Model for Virtual Try-On

2024-10-31 · Johanna Karras, Yingwei Li, Nan Liu, Luyang Zhu, Innfarn Yoo, Andreas Lugmayr, Chris Lee, Ira Kemelmacher-Shlizerman

We present Fashion-VDM, a video diffusion model (VDM) for generating virtual try-on videos. Given an input garment image and person video, our method aims to generate a high-quality try-on video of the person wearing the given garment, while preserving the person's identity and motion. Image-based virtual try-on has shown impressive results; however, existing video virtual try-on (VVT) methods are still lacking garment details and temporal consistency. To address these issues, we propose a diffusion-based architecture for video virtual try-on, split classifier-free guidance for increased control over the conditioning inputs, and a progressive temporal training strategy for single-pass 64-frame, 512px video generation. We also demonstrate the effectiveness of joint image-video training for video try-on, especially when video data is limited. Our qualitative and quantitative experiments show that our approach sets the new state-of-the-art for video virtual try-on. For additional results, visit our project page: https://johannakarras.github.io/Fashion-VDM.

📄 PDF Abstract BibTeX arXiv:2411.00225

Code (0)

등록된 구현이 없습니다.

Tasks

Video GenerationVirtual Try-on

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery

2023-09-29 · Tasin Islam, Alina Miron, Xiaohui Liu, Yongmin Li

Our study introduces a new image-to-video generator called FashionFlow to generate fashion videos. By utilising a diffusion model, we are able to create short videos from still fashion images. Our approach involves devel…

DiffusionTrend: A Minimalist Approach to Virtual Fashion Try-On

2024-12-19 · Wengyi Zhan, Mingbao Lin, Shuicheng Yan, Rongrong Ji

We introduce DiffusionTrend for virtual fashion try-on, which forgoes the need for retraining diffusion models. Using advanced diffusion models, DiffusionTrend harnesses latent information rich in prior information to ca…

DenoisingImage GenerationVirtual Try-on

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion

2023-04-12 · Johanna Karras, Aleksander Holynski, Ting-Chun Wang, Ira Kemelmacher-Shlizerman

We present DreamPose, a diffusion-based method for generating animated fashion videos from still images. Given an image and a sequence of human body poses, our method synthesizes a video containing both human and fabric …

Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models

2024-02-02 · Justin Blalock, David Munechika, Harsha Karanth, Alec Helbling 외

The growing digital landscape of fashion e-commerce calls for interactive and user-friendly interfaces for virtually trying on clothes. Traditional try-on methods grapple with challenges in adapting to diverse background…

Image GenerationModel CompressionVirtual Try-on

DreamPose: Fashion Video Synthesis with Stable Diffusion

2023-01-01 · ICCV 2023 1 · Johanna Karras, Aleksander Holynski, Ting-Chun Wang, Ira Kemelmacher-Shlizerman

We present DreamPose, a diffusion-based method for generating animated fashion videos from still images. Given an image and a sequence of human body poses, our method synthesizes a video containing both human and fab…