paper-with-me

Papers

TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models

2024-11-27 · Riza Velioglu, Petra Bevandic, Robin Chan, Barbara Hammer

This paper introduces Virtual Try-Off (VTOFF), a novel task focused on generating standardized garment images from single photos of clothed individuals. Unlike traditional Virtual Try-On (VTON), which digitally dresses models, VTOFF aims to extract a canonical garment image, posing unique challenges in capturing garment shape, texture, and intricate patterns. This well-defined target makes VTOFF particularly effective for evaluating reconstruction fidelity in generative models. We present TryOffDiff, a model that adapts Stable Diffusion with SigLIP-based visual conditioning to ensure high fidelity and detail retention. Experiments on a modified VITON-HD dataset show that our approach outperforms baseline methods based on pose transfer and virtual try-on with fewer pre- and post-processing steps. Our analysis reveals that traditional image generation metrics inadequately assess reconstruction quality, prompting us to rely on DISTS for more accurate evaluation. Our results highlight the potential of VTOFF to enhance product imagery in e-commerce applications, advance generative model evaluation, and inspire future work on high-fidelity reconstruction. Demo, code, and models are available at: https://rizavelioglu.github.io/tryoffdiff/

📄 PDF Abstract BibTeX arXiv:2411.18350

Code (1)

rizavelioglu/tryoffdiff 공식 구현 pytorch

Tasks

Garment ReconstructionImage GenerationPose TransferVirtual Try-OffVirtual Try-on

Methods 이 논문이 사용한 방법론

EXP-$Does Expedia refund a cancelled flight? EXP-$Does Expedia refund a cancelled flight? If you’re wondering, +1 888-829-0881 does Expedia refund a cancelled flight, the answer depends+1 888-829-0881 on the airline’s…
Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Adapter 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Enhancing Person-to-Person Virtual Try-On with Multi-Garment Virtual Try-Off

2025-04-17 · Riza Velioglu, Petra Bevandic, Robin Chan, Barbara Hammer

Computer vision is transforming fashion through Virtual Try-On (VTON) and Virtual Try-Off (VTOFF). VTON generates images of a person in a specified garment using a target photo and a standardized garment image, while a m…

Garment ReconstructionImage GenerationVirtual Try-OffVirtual Try-on

ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstruction

2026-01-23 · Ming Li, Hui Shan, Kai Zheng, Chentao Shen 외 arxiv

High-quality 3D garment reconstruction plays a crucial role in mitigating the sim-to-real gap in applications such as digital avatars, virtual try-on and robotic manipulation. However, existing garment reconstruction met…

Garment ReconstructionVirtual Try-on

DualFit: A Two-Stage Virtual Try-On via Warping and Synthesis

2025-08-16 · Minh Tran, Johnmark Clements, Annie Prasanna, Tri Nguyen 외 arxiv

Virtual Try-On technology has garnered significant attention for its potential to transform the online fashion retail experience by allowing users to visualize how garments would look on them without physical trials. Whi…

Virtual Try-on

Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates

2025-04-11 · Ren Li, Cong Cao, Corentin Dumery, Yingxuan You 외

Reconstructing 3D clothed humans from images is fundamental to applications like virtual try-on, avatar creation, and mixed reality. While recent advances have enhanced human body recovery, accurate reconstruction of gar…

3D geometryGarment ReconstructionMixed RealityVirtual Try-on

FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-on

2024-11-15 · Boyuan Jiang, Xiaobin Hu, Donghao Luo, Qingdong He 외

Although image-based virtual try-on has made considerable progress, emerging approaches still encounter challenges in producing high-fidelity and robust fitting images across diverse scenarios. These methods often strugg…

Virtual Try-on