Model-Driven Feed-Forward Prediction for Manipulation of Deformable Objects

2016-07-15 · Yinxiao Li, Yan Wang, Yonghao Yue, Danfei Xu, Michael Case, Shih-Fu Chang, Eitan Grinspun, Peter Allen

Robotic manipulation of deformable objects is a difficult problem especially because of the complexity of the many different ways an object can deform. Searching such a high dimensional state space makes it difficult to recognize, track, and manipulate deformable objects. In this paper, we introduce a predictive, model-driven approach to address this challenge, using a pre-computed, simulated database of deformable object models. Mesh models of common deformable garments are simulated with the garments picked up in multiple different poses under gravity, and stored in a database for fast and efficient retrieval. To validate this approach, we developed a comprehensive pipeline for manipulating clothing as in a typical laundry task. First, the database is used for category and pose estimation for a garment in an arbitrary position. A fully featured 3D model of the garment is constructed in real-time and volumetric features are then used to obtain the most similar model in the database to predict the object category and pose. Second, the database can significantly benefit the manipulation of deformable objects via non-rigid registration, providing accurate correspondences between the reconstructed object model and the database models. Third, the accurate model simulation can also be used to optimize the trajectories for manipulation of deformable objects, such as the folding of garments. Extensive experimental results are shown for the tasks above using a variety of different clothing.

📄 PDF Abstract BibTeX arXiv:1607.04411

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectPose Estimation Retrieval

Robustness without Wrinkles: Parallel Simulation and Robust MPC for Certified Deformable Manipulation

2026-06-12 · Wei-Chen Li, Jeffrey Fang, Sasanka Polisetti, Yuexi Song 외 arxiv

We present CORD-SLS, a real-time control method for safe deformable object manipulation, with a focus on ropes and cloth. At its core is a GPU-parallel differentiable simulator with contact smoothing which enables effici…

SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation

2020-11-14 · Xingyu Lin, YuFei Wang, Jake Olkin, David Held

Manipulating deformable objects has long been a challenge in robotics due to its high dimensional state representation and complex dynamics. Recent success in deep reinforcement learning provides a promising direction fo…

Benchmarking Deep Reinforcement Learning Deformable Object Manipulation Object+4

RL-Based Coverage Path Planning for Deformable Objects on 3D Surfaces

2026-03-03 · Yuhang Zhang, Jinming Ma, Feng Wu arxiv

Currently, manipulation tasks for deformable objects often focus on activities like folding clothes, handling ropes, and manipulating bags. However, research on contact-rich tasks involving deformable objects remains rel…

Reinforcement Learning

DeformGen: Dynamics-Based Topology Augmentation for Deformable Manipulation Policy Learning

2026-06-24 · Zili Lin, Wenyao Zhang, Yuyang Zhang, Zekun Qi 외 arxiv

Demonstration augmentation is proposed for cost-efficient data acquisition, but existing methods are fundamentally limited in deformable manipulation due to two challenges: (1) the state space is high-dimensional with ph…

ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation

2022-03-14 · Bokui Shen, Zhenyu Jiang, Christopher Choy, Leonidas J. Guibas 외

Manipulating volumetric deformable objects in the real world, like plush toys and pizza dough, bring substantial challenges due to infinite shape variations, non-rigid motions, and partial observability. We introduce ACI…

Contrastive Learning Deformable Object Manipulation