paper-with-me

Papers

Zero-Shot Transfer of Haptics-Based Object Insertion Policies

2023-01-29 · Samarth Brahmbhatt, Ankur Deka, Andrew Spielberg, Matthias Müller

Humans naturally exploit haptic feedback during contact-rich tasks like loading a dishwasher or stocking a bookshelf. Current robotic systems focus on avoiding unexpected contact, often relying on strategically placed environment sensors. Recently, contact-exploiting manipulation policies have been trained in simulation and deployed on real robots. However, they require some form of real-world adaptation to bridge the sim-to-real gap, which might not be feasible in all scenarios. In this paper we train a contact-exploiting manipulation policy in simulation for the contact-rich household task of loading plates into a slotted holder, which transfers without any fine-tuning to the real robot. We investigate various factors necessary for this zero-shot transfer, like time delay modeling, memory representation, and domain randomization. Our policy transfers with minimal sim-to-real gap and significantly outperforms heuristic and learnt baselines. It also generalizes to plates of different sizes and weights. Demonstration videos and code are available at https://sites.google.com/view/compliant-object-insertion.

📄 PDF Abstract BibTeX arXiv:2301.12587

Code (1)

isl-org/0shot-object-insertion 공식 구현

Similar Papers 제목 키워드 기반

DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Image

2025-03-13 · Qi Zhao, Zhan Ma, Pan Zhou

Recent developments in generative diffusion models have turned many dreams into realities. For video object insertion, existing methods typically require additional information, such as a reference video or a 3D asset of…

Object

Zero-Shot Peg Insertion: Identifying Mating Holes and Estimating SE(2) Poses with Vision-Language Models

2025-03-08 · Masaru Yajima, Kei Ota, Asako Kanezaki, Rei Kawakami

Achieving zero-shot peg insertion, where inserting an arbitrary peg into an unseen hole without task-specific training, remains a fundamental challenge in robotics. This task demands a highly generalizable perception sys…

RoAD Benchmark: How LiDAR Models Fail under Coupled Domain Shifts and Label Evolution

2026-01-09 · Subeen Lee, Siyeong Lee, Namil Kim, Jaesik Choi arxiv

For 3D perception systems to operate reliably in real-world environments, they must remain robust to evolving sensor characteristics and changes in object taxonomies. However, existing adaptive learning paradigms struggl…

Self-Supervised LearningContinual LearningAutonomous Driving

Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole

2026-03-04 · Masaru Yajima, Yuma Shin, Rei Kawakami, Asako Kanezaki 외 arxiv

Reliable insertion of industrial connectors remains a central challenge in robotics, requiring sub-millimeter precision under uncertainty and often without full visual access. Vision-based approaches struggle with occlus…

Pose Estimation

EasyInsert: A Data-Efficient and Generalizable Insertion Policy

2025-05-22 · Guanghe Li, Junming Zhao, Shengjie Wang, Yang Gao

Insertion task is highly challenging that requires robots to operate with exceptional precision in cluttered environments. Existing methods often have poor generalization capabilities. They typically function in restrict…

Pose PredictionZero-shot Generalization