paper-with-me

홈 › Papers

FoldNet: Learning Generalizable Closed-Loop Policy for Garment Folding via Keypoint-Driven Asset and Demonstration Synthesis

2025-05-14 · Yuxing Chen, Bowen Xiao, He Wang

Due to the deformability of garments, generating a large amount of high-quality data for robotic garment manipulation tasks is highly challenging. In this paper, we present a synthetic garment dataset that can be used for robotic garment folding. We begin by constructing geometric garment templates based on keypoints and applying generative models to generate realistic texture patterns. Leveraging these keypoint annotations, we generate folding demonstrations in simulation and train folding policies via closed-loop imitation learning. To improve robustness, we propose KG-DAgger, which uses a keypoint-based strategy to generate demonstration data for recovering from failures. KG-DAgger significantly improves the model performance, boosting the real-world success rate by 25\%. After training with 15K trajectories (about 2M image-action pairs), the model achieves a 75\% success rate in the real world. Experiments in both simulation and real-world settings validate the effectiveness of our proposed framework.

📄 PDF Abstract BibTeX arXiv:2505.09109

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learning

Similar Papers 제목 키워드 기반

UniFolding: Towards Sample-efficient, Scalable, and Generalizable Robotic Garment Folding

2023-11-02 · Han Xue, Yutong Li, Wenqiang Xu, Huanyu Li 외

This paper explores the development of UniFolding, a sample-efficient, scalable, and generalizable robotic system for unfolding and folding various garments. UniFolding employs the proposed UFONet neural network to integ…

DexGarmentLab: Dexterous Garment Manipulation Environment with Generalizable Policy

2025-05-16 · Yuran Wang, Ruihai Wu, Yue Chen, Jiarui Wang 외

Garment manipulation is a critical challenge due to the diversity in garment categories, geometries, and deformations. Despite this, humans can effortlessly handle garments, thanks to the dexterity of our hands. However,…

Reinforcement Learning (RL)

Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulation

2024-05-02 · Homanga Bharadhwaj, Roozbeh Mottaghi, Abhinav Gupta, Shubham Tulsiani

We seek to learn a generalizable goal-conditioned policy that enables zero-shot robot manipulation: interacting with unseen objects in novel scenes without test-time adaptation. While typical approaches rely on a large a…

Robot ManipulationTest-time Adaptation

Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method

2022-11-29 · Kedan Li, Jeffrey Zhang, Shao-Yu Chang, David Forsyth

An outfit visualization method generates an image of a person wearing real garments from images of those garments. Current methods can produce images that look realistic and preserve garment identity, captured in details…

Virtual Try-on

PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors

2018-08-30 · ECCV 2018 9 · Haowen Deng, Tolga Birdal, Slobodan Ilic

We present PPF-FoldNet for unsupervised learning of 3D local descriptors on pure point cloud geometry. Based on the folding-based auto-encoding of well known point pair features, PPF-FoldNet offers many desirable propert…

Point Cloud Registration