paper-with-me

Papers

AIpparel: A Large Multimodal Generative Model for Digital Garments

2024-12-05 · Kiyohiro Nakayama, Jan Ackermann, Timur Levent Kesdogan, Yang Zheng, Maria Korosteleva, Olga Sorkine-Hornung, Leonidas J. Guibas, Guandao Yang, Gordon Wetzstein

Apparel is essential to human life, offering protection, mirroring cultural identities, and showcasing personal style. Yet, the creation of garments remains a time-consuming process, largely due to the manual work involved in designing them. To simplify this process, we introduce AIpparel, a large multimodal model for generating and editing sewing patterns. Our model fine-tunes state-of-the-art large multimodal models (LMMs) on a custom-curated large-scale dataset of over 120,000 unique garments, each with multimodal annotations including text, images, and sewing patterns. Additionally, we propose a novel tokenization scheme that concisely encodes these complex sewing patterns so that LLMs can learn to predict them efficiently. AIpparel achieves state-of-the-art performance in single-modal tasks, including text-to-garment and image-to-garment prediction, and enables novel multimodal garment generation applications such as interactive garment editing. The project website is at georgenakayama.github.io/AIpparel/.

📄 PDF Abstract BibTeX arXiv:2412.03937

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AIpparel: A Multimodal Foundation Model for Digital Garments

2025-01-01 · CVPR 2025 1 · Kiyohiro Nakayama, Jan Ackermann, Timur Levent Kesdogan, Yang Zheng 외

Apparel is essential to human life, offering protection, mirroring cultural identities, and showcasing personal style. Yet, the creation of garments remains a time-consuming process, largely due to the manual work in…

GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling

2025-04-02 · Siran Li, Chen Liu, Ruiyang Liu, Zhendong Wang 외

Realistic digital garment modeling remains a labor-intensive task due to the intricate process of translating 2D sewing patterns into high-fidelity, simulation-ready 3D garments. We introduce GarmageNet, a unified genera…

GarmentSketch: Large-scale Sketch-to-Fashion Benchmark

2026-06-12 · Duong-Duy-Khang Bui, Minh-Tan Pham, Tam V. Nguyen, Minh-Triet Tran 외 arxiv

Fashion sketching is a cornerstone of design workflows, allowing rapid visualization of creative concepts prior to physical prototyping. Yet, progress in sketch-based fashion image synthesis has been hindered by the abse…

Text-to-Image Generation

Multi-Garment Net: Learning to Dress 3D People from Images

2019-08-19 · ICCV 2019 10 · Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-Moll

We present Multi-Garment Network (MGN), a method to predict body shape and clothing, layered on top of the SMPL model from a few frames (1-8) of a video. Several experiments demonstrate that this representation allows hi…

3D Human Pose Estimation3D Shape Reconstruction3D Shape Reconstruction From A Single 2D Image

DressCode: Autoregressively Sewing and Generating Garments from Text Guidance

2024-01-29 · Kai He, Kaixin Yao, Qixuan Zhang, Jingyi Yu 외

Apparel's significant role in human appearance underscores the importance of garment digitalization for digital human creation. Recent advances in 3D content creation are pivotal for digital human creation. Nonetheless, …

Language ModellingLarge Language ModelTexture SynthesisVirtual Try-on