paper-with-me

Papers

SNUG: Self-Supervised Neural Dynamic Garments

2022-04-05 · CVPR 2022 1 · Igor Santesteban, Miguel A. Otaduy, Dan Casas

We present a self-supervised method to learn dynamic 3D deformations of garments worn by parametric human bodies. State-of-the-art data-driven approaches to model 3D garment deformations are trained using supervised strategies that require large datasets, usually obtained by expensive physics-based simulation methods or professional multi-camera capture setups. In contrast, we propose a new training scheme that removes the need for ground-truth samples, enabling self-supervised training of dynamic 3D garment deformations. Our key contribution is to realize that physics-based deformation models, traditionally solved in a frame-by-frame basis by implicit integrators, can be recasted as an optimization problem. We leverage such optimization-based scheme to formulate a set of physics-based loss terms that can be used to train neural networks without precomputing ground-truth data. This allows us to learn models for interactive garments, including dynamic deformations and fine wrinkles, with two orders of magnitude speed up in training time compared to state-of-the-art supervised methods

📄 PDF Abstract BibTeX arXiv:2204.02219

Code (1)

isantesteban/snug 공식 구현 tf

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Dress-Me-Up: A Dataset & Method for Self-Supervised 3D Garment Retargeting

2024-01-06 · Shanthika Naik, Kunwar Singh, Astitva Srivastava, Dhawal Sirikonda 외

We propose a novel self-supervised framework for retargeting non-parameterized 3D garments onto 3D human avatars of arbitrary shapes and poses, enabling 3D virtual try-on (VTON). Existing self-supervised 3D retargeting m…

Virtual Try-on

DrapeNet: Garment Generation and Self-Supervised Draping

2022-11-21 · CVPR 2023 1 · Luca De Luigi, Ren Li, Benoît Guillard, Mathieu Salzmann 외

Recent approaches to drape garments quickly over arbitrary human bodies leverage self-supervision to eliminate the need for large training sets. However, they are designed to train one network per clothing item, which se…

SpeedFolding: Learning Efficient Bimanual Folding of Garments

2022-08-22 · Yahav Avigal, Lars Berscheid, Tamim Asfour, Torsten Kröger 외

Folding garments reliably and efficiently is a long standing challenge in robotic manipulation due to the complex dynamics and high dimensional configuration space of garments. An intuitive approach is to initially manip…

Learning 3D Garment Animation from Trajectories of A Piece of Cloth

2025-01-02 · Yidi Shao, Chen Change Loy, Bo Dai

Garment animation is ubiquitous in various applications, such as virtual reality, gaming, and film producing. Recently, learning-based approaches obtain compelling performance in animating diverse garments under versatil…

SwinGar: Spectrum-Inspired Neural Dynamic Deformation for Free-Swinging Garments

2023-08-05 · TianXing Li, Rui Shi, Qing Zhu, Takashi Kanai

Our work presents a novel spectrum-inspired learning-based approach for generating clothing deformations with dynamic effects and personalized details. Existing methods in the field of clothing animation are limited to e…