paper-with-me

Papers

DiCTI: Diffusion-based Clothing Designer via Text-guided Input

2024-07-04 · Ajda Lampe, Julija Stopar, Deepak Kumar Jain, Shinichiro Omachi, Peter Peer, Vitomir Štruc

Recent developments in deep generative models have opened up a wide range of opportunities for image synthesis, leading to significant changes in various creative fields, including the fashion industry. While numerous methods have been proposed to benefit buyers, particularly in virtual try-on applications, there has been relatively less focus on facilitating fast prototyping for designers and customers seeking to order new designs. To address this gap, we introduce DiCTI (Diffusion-based Clothing Designer via Text-guided Input), a straightforward yet highly effective approach that allows designers to quickly visualize fashion-related ideas using text inputs only. Given an image of a person and a description of the desired garments as input, DiCTI automatically generates multiple high-resolution, photorealistic images that capture the expressed semantics. By leveraging a powerful diffusion-based inpainting model conditioned on text inputs, DiCTI is able to synthesize convincing, high-quality images with varied clothing designs that viably follow the provided text descriptions, while being able to process very diverse and challenging inputs, captured in completely unconstrained settings. We evaluate DiCTI in comprehensive experiments on two different datasets (VITON-HD and Fashionpedia) and in comparison to the state-of-the-art (SoTa). The results of our experiments show that DiCTI convincingly outperforms the SoTA competitor in generating higher quality images with more elaborate garments and superior text prompt adherence, both according to standard quantitative evaluation measures and human ratings, generated as part of a user study.

📄 PDF Abstract BibTeX arXiv:2407.03901

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationVirtual Try-on

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

ControlEdit: A MultiModal Local Clothing Image Editing Method

2024-09-23 · Di Cheng, Yingjie Shi, ShiXin Sun, JiaFu Zhang 외

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work …

Self-Supervised Learning

A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidance

2023-12-24 · Shufang Zhang, Minxue Ni, Lei Wang, Wenxin Ding 외

The Diffusion model has a strong ability to generate wild images. However, the model can just generate inaccurate images with the guidance of text, which makes it very challenging to directly apply the text-guided genera…

Virtual Try-on

Learning 3D Texture-Aware Representations for Parsing Diverse Human Clothing and Body Parts

2025-08-08 · Kiran Chhatre, Christopher Peters, Srikrishna Karanam arxiv

Existing methods for human parsing into body parts and clothing often use fixed mask categories with broad labels that obscure fine-grained clothing types. Recent open-vocabulary segmentation approaches leverage pretrain…

Semantic SegmentationHuman Parsing

3DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models

2022-11-25 · Gang Li, Heliang Zheng, Chaoyue Wang, Chang Li 외

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting …

DenoisingNeRFNovel View SynthesisVideo Generation

TruePose: Human-Parsing-guided Attention Diffusion for Full-ID Preserving Pose Transfer

2025-02-05 · Zhihong Xu, Dongxia Wang, Peng Du, Yang Cao 외

Pose-Guided Person Image Synthesis (PGPIS) generates images that maintain a subject's identity from a source image while adopting a specified target pose (e.g., skeleton). While diffusion-based PGPIS methods effectively …

DenoisingHuman ParsingImage GenerationPose Transfer