Image-based Virtual Fitting Room

2021-04-08 · Zhiling Huang, Junwen Bu, Jie Chen

Virtual fitting room is a challenging task yet useful feature for e-commerce platforms and fashion designers. Existing works can only detect very few types of fashion items. Besides they did poorly in changing the texture and style of the selected fashion items. In this project, we propose a novel approach to address this problem. We firstly used Mask R-CNN to find the regions of different fashion items, and secondly used Neural Style Transfer to change the style of the selected fashion items. The dataset we used is composed of images from PaperDoll dataset and annotations provided by eBay's ModaNet. We trained 8 models and our best model massively outperformed baseline models both quantitatively and qualitatively, with 68.72% mAP, 0.2% ASDR.

📄 PDF Abstract BibTeX arXiv:2104.04104

Code (1)

jiechen2358/VirtualFittingRoom 공식 구현 tf

Tasks

Style Transfer

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Preview

2025-09-04 · Jun-Kun Chen, Aayush Bansal, Minh Phuoc Vo, Yu-Xiong Wang arxiv

We introduce the Virtual Fitting Room (VFR), a novel video generative model that produces arbitrarily long virtual try-on videos. Our VFR models long video generation tasks as an auto-regressive, segment-by-segment gener…

Video Generation Virtual Try-on

Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models

2024-02-02 · Justin Blalock, David Munechika, Harsha Karanth, Alec Helbling 외

The growing digital landscape of fashion e-commerce calls for interactive and user-friendly interfaces for virtually trying on clothes. Traditional try-on methods grapple with challenges in adapting to diverse background…

Image Generation Model Compression Virtual Try-on

A Cost-Efficient Approach for Creating Virtual Fitting Room using Generative Adversarial Networks (GANs)

2024-02-01 · Kirolos Attallah, Girgis Zaky, Nourhan Abdelrhim, Kyrillos Botros 외

Customers all over the world want to see how the clothes fit them or not before purchasing. Therefore, customers by nature prefer brick-and-mortar clothes shopping so they can try on products before purchasing them. But …

Augment Yourself: Mixed Reality Self-Augmentation Using Optical See-through Head-mounted Displays and Physical Mirrors

2020-07-06 · Mathias Unberath, Kevin Yu, Roghayeh Barmaki, Alex Johnson 외

Optical see-though head-mounted displays (OST HMDs) are one of the key technologies for merging virtual objects and physical scenes to provide an immersive mixed reality (MR) environment to its user. A fundamental limita…

Anatomy Mixed Reality

Dancing Points: Synthesizing Ballroom Dancing with Three-Point Inputs

2026-01-05 · Peizhuo Li, Sebastian Starke, Yuting Ye, Olga Sorkine-Hornung arxiv

Ballroom dancing is a structured yet expressive motion category. Its highly diverse movement and complex interactions between leader and follower dancers make the understanding and synthesis challenging. We demonstrate t…