paper-with-me

홈 › Papers

Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation

2026-06-02 · Yilong Wang, Cheng Qian, Edward Johns arxiv

Deformable object manipulation (DOM) is challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multiple valid manipulation modes. We introduce Instant-Fold, an in-context imitation learning framework for DOM. Given a single human demonstration, our policy infers and executes diverse manipulation modes directly from the demonstration, including variations in spatial execution and ordering, without requiring gradient updates. Our approach first learns deformation-aware visual representations via temporal contrastive pretraining, after which a flow-matching transformer policy conditioned on the demonstration predicts actions to execute the intended manipulation mode. Trained entirely in simulation, Instant-Fold generalizes across diverse folding modes and transfers zero-shot to real-world settings without additional data collection or finetuning. Videos are available at https://instant-fold.github.io.

📄 PDF Abstract BibTeX arXiv:2606.04269

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FolDeX: A Physical-World Benchmark for Long-Horizon Robotic Manipulation of Deformable Objects

2026-09-09 · Chenhuan Liu, Yi Xu, Feng Wu, Hanyang Wang 외 arxiv

Embodied AI, including vision-language-action and world-action models, must operate reliably in the physical world. Yet methods that perform well in simulation can degrade substantially on real robots, especially in long…

Learning Correspondence for Deformable Objects

2024-05-14 · Priya Sundaresan, Aditya Ganapathi, Harry Zhang, Shivin Devgon

We investigate the problem of pixelwise correspondence for deformable objects, namely cloth and rope, by comparing both classical and learning-based methods. We choose cloth and rope because they are traditionally some o…

ObjectObject Tracking

Sim-to-Real Reinforcement Learning for Deformable Object Manipulation

2018-06-20 · Jan Matas, Stephen James, Andrew J. Davison

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional m…

Deep Reinforcement LearningDeformable Object ManipulationObjectreinforcement-learning+2

Structure-Regularized Attention for Deformable Object Representation

2021-06-12 · Shenao Zhang, Li Shen, Zhifeng Li, Wei Liu

Capturing contextual dependencies has proven useful to improve the representational power of deep neural networks. Recent approaches that focus on modeling global context, such as self-attention and non-local operation, …

Object

DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulation

2023-11-30 · Bardienus P. Duisterhof, Zhao Mandi, Yunchao Yao, Jia-Wei Liu 외

Teaching robots to fold, drape, or reposition deformable objects such as cloth will unlock a variety of automation applications. While remarkable progress has been made for rigid object manipulation, manipulating deforma…

Deformable Object ManipulationImitation LearningNovel View SynthesisPose Estimation