paper-with-me

홈 › Papers

Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy

2025-05-23 · Guanzhou Lan, YuQi Yang, Anup Teejo Mathew, Feiping Nie, Rong Wang, Xuelong Li, Federico Renda, Bin Zhao

Goal-conditioned dynamic manipulation is inherently challenging due to complex system dynamics and stringent task constraints, particularly in deformable object scenarios characterized by high degrees of freedom and underactuation. Prior methods often simplify the problem to low-speed or 2D settings, limiting their applicability to real-world 3D tasks. In this work, we explore 3D goal-conditioned rope manipulation as a representative challenge. To mitigate data scarcity, we introduce a novel simulation framework and benchmark grounded in reduced-order dynamics, which enables compact state representation and facilitates efficient policy learning. Building on this, we propose Dynamics Informed Diffusion Policy (DIDP), a framework that integrates imitation pretraining with physics-informed test-time adaptation. First, we design a diffusion policy that learns inverse dynamics within the reduced-order space, enabling imitation learning to move beyond na\"ive data fitting and capture the underlying physical structure. Second, we propose a physics-informed test-time adaptation scheme that imposes kinematic boundary conditions and structured dynamics priors on the diffusion process, ensuring consistency and reliability in manipulation execution. Extensive experiments validate the proposed approach, demonstrating strong performance in terms of accuracy and robustness in the learned policy.

📄 PDF Abstract BibTeX arXiv:2505.17434

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningTest-time Adaptation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Learning Predictive Representations for Deformable Objects Using Contrastive Estimation

2020-03-11 · Wilson Yan, Ashwin Vangipuram, Pieter Abbeel, Lerrel Pinto

Using visual model-based learning for deformable object manipulation is challenging due to difficulties in learning plannable visual representations along with complex dynamic models. In this work, we propose a new learn…

Deformable Object Manipulation

Real Garment Benchmark (RGBench): A Comprehensive Benchmark for Robotic Garment Manipulation featuring a High-Fidelity Scalable Simulator

2025-11-09 · Wenkang Hu, Xincheng Tang, Yanzhi E, Yitong Li 외 arxiv

While there has been significant progress to use simulated data to learn robotic manipulation of rigid objects, applying its success to deformable objects has been hindered by the lack of both deformable object models an…

Benchmarking the Sim-to-Real Gap in Cloth Manipulation

2023-10-14 · David Blanco-Mulero, Oriol Barbany, Gokhan Alcan, Adrià Colomé 외

Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object…

BenchmarkingMuJoCoObject

Rapid Adaptation of Particle Dynamics for Generalized Deformable Object Mobile Manipulation

2026-03-18 · Bohan Wu, Roberto Martín-Martín, Li Fei-Fei arxiv

We address the challenge of learning to manipulate deformable objects with unknown dynamics. In non-rigid objects, the dynamics parameters define how they react to interactions -- how they stretch, bend, compress, and mo…

ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation

2022-03-14 · Bokui Shen, Zhenyu Jiang, Christopher Choy, Leonidas J. Guibas 외

Manipulating volumetric deformable objects in the real world, like plush toys and pizza dough, bring substantial challenges due to infinite shape variations, non-rigid motions, and partial observability. We introduce ACI…

Contrastive LearningDeformable Object Manipulation