paper-with-me

Papers

Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimation

2021-03-15 · Solvi Arnold, Daisuke Tanaka, Kimitoshi Yamazaki

We consider the problem of open-goal planning for robotic cloth manipulation. Core of our system is a neural network trained as a forward model of cloth behaviour under manipulation, with planning performed through backpropagation. We introduce a neural network-based routine for estimating mesh representations from voxel input, and perform planning in mesh format internally. We address the problem of planning with incomplete domain knowledge by means of an explicit epistemic uncertainty signal. This signal is calculated from prediction divergence between two instances of the forward model network and used to avoid epistemic uncertainty during planning. Finally, we introduce logic for handling restriction of grasp points to a discrete set of candidates, in order to accommodate graspability constraints imposed by robotic hardware. We evaluate the system's mesh estimation, prediction, and planning ability on simulated cloth for sequences of one to three manipulations. Comparative experiments confirm that planning on basis of estimated meshes improves accuracy compared to voxel-based planning, and that epistemic uncertainty avoidance improves performance under conditions of incomplete domain knowledge. Planning time cost is a few seconds. We additionally present qualitative results on robot hardware.

📄 PDF Abstract BibTeX arXiv:2103.08137

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mesh-based Dynamics with Occlusion Reasoning for Cloth Manipulation

2022-06-06 · Zixuan Huang, Xingyu Lin, David Held

Self-occlusion is challenging for cloth manipulation, as it makes it difficult to estimate the full state of the cloth. Ideally, a robot trying to unfold a crumpled or folded cloth should be able to reason about the clot…

Pose Estimation

PlaNet-ClothPick: Effective Fabric Flattening Based on Latent Dynamic Planning

2023-03-02 · Halid Abdulrahim Kadi, Kasim Terzic

Why do Recurrent State Space Models such as PlaNet fail at cloth manipulation tasks? Recent work has attributed this to the blurry prediction of the observation, which makes it difficult to plan directly in the latent sp…

State Space Models

Self-supervised Cloth Reconstruction via Action-conditioned Cloth Tracking

2023-02-19 · Zixuan Huang, Xingyu Lin, David Held

State estimation is one of the greatest challenges for cloth manipulation due to cloth's high dimensionality and self-occlusion. Prior works propose to identify the full state of crumpled clothes by training a mesh recon…

Self-Supervised LearningState Estimation

Enabling Robust Cloth Manipulation via Inference-Time Simulator-in-the-Loop Refinement

2026-06-23 · Xin Liu, Yulin Li, Ziming Li, Pengyu Jing 외 arxiv

Simulator-in-the-loop optimization offers a promising inference-time mechanism for robot manipulation. It uses a physical simulator as a backend rollout engine to evaluate candidate trajectories in parallel and refine no…

Robot Manipulation

CloSE: A Compact Shape- and Orientation-Agnostic Cloth State Representation

2025-04-07 · Jay Kamat, Júlia Borràs, Carme Torras

Cloth manipulation is a difficult problem mainly because of the non-rigid nature of cloth, which makes a good representation of deformation essential. We present a new representation for the deformation-state of clothes.…