paper-with-me

Papers

Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates

2025-04-11 · Ren Li, Cong Cao, Corentin Dumery, Yingxuan You, Hao Li, Pascal Fua

Reconstructing 3D clothed humans from images is fundamental to applications like virtual try-on, avatar creation, and mixed reality. While recent advances have enhanced human body recovery, accurate reconstruction of garment geometry -- especially for loose-fitting clothing -- remains an open challenge. We present a novel method for high-fidelity 3D garment reconstruction from single images that bridges 2D and 3D representations. Our approach combines Implicit Sewing Patterns (ISP) with a generative diffusion model to learn rich garment shape priors in a 2D UV space. A key innovation is our mapping model that establishes correspondences between 2D image pixels, UV pattern coordinates, and 3D geometry, enabling joint optimization of both 3D garment meshes and the corresponding 2D patterns by aligning learned priors with image observations. Despite training exclusively on synthetically simulated cloth data, our method generalizes effectively to real-world images, outperforming existing approaches on both tight- and loose-fitting garments. The reconstructed garments maintain physical plausibility while capturing fine geometric details, enabling downstream applications including garment retargeting and texture manipulation.

📄 PDF Abstract BibTeX arXiv:2504.08353

Code (1)

liren2515/dmap 공식 구현 pytorch

Tasks

3D geometryGarment ReconstructionMixed RealityVirtual Try-on

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates

2026-02-27 · Yingxuan You, Ren Li, Corentin Dumery, Cong Cao 외 arxiv

Reconstructing 3D clothed humans from monocular images and videos is a fundamental problem with applications in virtual try-on, avatar creation, and mixed reality. Despite significant progress in human body recovery, acc…

Dynamic ReconstructionGarment ReconstructionVirtual Try-on

GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing

2025-03-11 · Yuanhao Wang, Cheng Zhang, Gonçalo Frazão, Jinlong Yang 외

We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, cre…

3D ReconstructionDepth EstimationDepth PredictionGarment Reconstruction+3

Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics

2025-02-05 · Xuan Li, Chang Yu, Wenxin Du, Ying Jiang 외

Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focu…

3D ReconstructionImage to 3DMotion GenerationTexture Synthesis+1

Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstruction

2021-08-19 · ICCV 2021 10 · Fang Zhao, Wenhao Wang, Shengcai Liao, Ling Shao

While single-view 3D reconstruction has made significant progress benefiting from deep shape representations in recent years, garment reconstruction is still not solved well due to open surfaces, diverse topologies and c…

3D ReconstructionGarment ReconstructionSingle-View 3D Reconstruction

Reconstruction of Manipulated Garment with Guided Deformation Prior

2024-05-17 · Ren Li, Corentin Dumery, Zhantao Deng, Pascal Fua

Modeling the shape of garments has received much attention, but most existing approaches assume the garments to be worn by someone, which constrains the range of shapes they can assume. In this work, we address shape rec…