paper-with-me

Papers

OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on

2024-03-04 · Yuhao Xu, Tao Gu, Weifeng Chen, Chengcai Chen

We present OOTDiffusion, a novel network architecture for realistic and controllable image-based virtual try-on (VTON). We leverage the power of pretrained latent diffusion models, designing an outfitting UNet to learn the garment detail features. Without a redundant warping process, the garment features are precisely aligned with the target human body via the proposed outfitting fusion in the self-attention layers of the denoising UNet. In order to further enhance the controllability, we introduce outfitting dropout to the training process, which enables us to adjust the strength of the garment features through classifier-free guidance. Our comprehensive experiments on the VITON-HD and Dress Code datasets demonstrate that OOTDiffusion efficiently generates high-quality try-on results for arbitrary human and garment images, which outperforms other VTON methods in both realism and controllability, indicating an impressive breakthrough in virtual try-on. Our source code is available at https://github.com/levihsu/OOTDiffusion.

📄 PDF Abstract BibTeX arXiv:2403.01779

Code (2)

levihsu/ootdiffusion 공식 구현 pytorch
shinechen1024/magicclothing pytorch

Tasks

DenoisingImage GenerationVirtual Try-on

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

ODPG: Outfitting Diffusion with Pose Guided Condition

2025-01-12 · Seohyun Lee, Jintae Park, Sanghyeok Park

Virtual Try-On (VTON) technology allows users to visualize how clothes would look on them without physically trying them on, gaining traction with the rise of digitalization and online shopping. Traditional VTON methods,…

DenoisingVirtual Try-on

SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generation

2024-12-02 · CVPR 2025 1 · Alexey Bokhovkin, Quan Meng, Shubham Tulsiani, Angela Dai

We present SceneFactor, a diffusion-based approach for large-scale 3D scene generation that enables controllable generation and effortless editing. SceneFactor enables text-guided 3D scene synthesis through our factored …

Scene Generation

Contrastive Diffusion Alignment: Learning Structured Latents for Controllable Generation

2025-10-16 · Ruchi Sandilya, Sumaira Perez, Charles Lynch, Lindsay Victoria 외 arxiv

Diffusion models excel at generation, but their latent spaces are high dimensional and not explicitly organized for interpretation or control. We introduce ConDA (Contrastive Diffusion Alignment), a plug-and-play geometr…

Contrastive Learning

Improved Paraphrase Generation via Controllable Latent Diffusion

2024-04-13 · Wei Zou, Ziyuan Zhuang, Xiang Geng, ShuJian Huang 외

Paraphrase generation strives to generate high-quality and diverse expressions of a given text, a domain where diffusion models excel. Though SOTA diffusion generation reconciles generation quality and diversity, textual…

DiversityParaphrase Generation

AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation

2026-08-24 · Huiwen Han, Lulin Liu, Bangya Liu, Yuanhao Cai 외 arxiv

3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis. However, existing generative models typically synthesize 3D volumes monolithically, often overlo…