paper-with-me

Papers

PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns

2023-12-07 · CVPR 2024 1 · Shuliang Ning, Duomin Wang, Yipeng Qin, Zirong Jin, Baoyuan Wang, Xiaoguang Han

In this paper, we propose a novel virtual try-on from unconstrained designs (ucVTON) task to enable photorealistic synthesis of personalized composite clothing on input human images. Unlike prior arts constrained by specific input types, our method allows flexible specification of style (text or image) and texture (full garment, cropped sections, or texture patches) conditions. To address the entanglement challenge when using full garment images as conditions, we develop a two-stage pipeline with explicit disentanglement of style and texture. In the first stage, we generate a human parsing map reflecting the desired style conditioned on the input. In the second stage, we composite textures onto the parsing map areas based on the texture input. To represent complex and non-stationary textures that have never been achieved in previous fashion editing works, we first propose extracting hierarchical and balanced CLIP features and applying position encoding in VTON. Experiments demonstrate superior synthesis quality and personalization enabled by our method. The flexible control over style and texture mixing brings virtual try-on to a new level of user experience for online shopping and fashion design.

📄 PDF Abstract BibTeX arXiv:2312.04534

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementHuman ParsingVirtual Try-on

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering

2024-08-19 · Ruofan Liang, Zan Gojcic, Merlin Nimier-David, David Acuna 외

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diff…

Inverse RenderingObjectTone Mapping

DiCTI: Diffusion-based Clothing Designer via Text-guided Input

2024-07-04 · Ajda Lampe, Julija Stopar, Deepak Kumar Jain, Shinichiro Omachi 외

Recent developments in deep generative models have opened up a wide range of opportunities for image synthesis, leading to significant changes in various creative fields, including the fashion industry. While numerous me…

Image GenerationVirtual Try-on

DreamCreature: Crafting Photorealistic Virtual Creatures from Imagination

2023-11-27 · Kam Woh Ng, Xiatian Zhu, Yi-Zhe Song, Tao Xiang

Recent text-to-image (T2I) generative models allow for high-quality synthesis following either text instructions or visual examples. Despite their capabilities, these models face limitations in creating new, detailed cre…

DisentanglementNovel Concepts

Picture that Sketch: Photorealistic Image Generation from Abstract Sketches

2023-03-20 · CVPR 2023 1 · Subhadeep Koley, Ayan Kumar Bhunia, Aneeshan Sain, Pinaki Nath Chowdhury 외

Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this paper turns it into a photorealistic image - just like those shown in Fig. 1(a), all non-cherry-picked. We differ significantly f…

DecoderImage GenerationImage RetrievalRetrieval+1

A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors

2020-02-20 · Ruobing Zheng, Zhou Zhu, Bo Song, Changjiang Ji

Lip sync has emerged as a promising technique for generating mouth movements from audio signals. However, synthesizing a high-resolution and photorealistic virtual news anchor is still challenging. Lack of natural appear…

Constrained Lip-synchronizationImage-to-Image TranslationNeural Rendering