paper-with-me

Papers

EasyInsert: A Data-Efficient and Generalizable Insertion Policy

2025-05-22 · Guanghe Li, Junming Zhao, Shengjie Wang, Yang Gao

Insertion task is highly challenging that requires robots to operate with exceptional precision in cluttered environments. Existing methods often have poor generalization capabilities. They typically function in restricted and structured environments, and frequently fail when the plug and socket are far apart, when the scene is densely cluttered, or when handling novel objects. They also rely on strong assumptions such as access to CAD models or a digital twin in simulation. To address this, we propose EasyInsert, a framework which leverages the human intuition that relative pose (delta pose) between plug and socket is sufficient for successful insertion, and employs efficient and automated real-world data collection with minimal human labor to train a generalizable model for relative pose prediction. During execution, EasyInsert follows a coarse-to-fine execution procedure based on predicted delta pose, and successfully performs various insertion tasks. EasyInsert demonstrates strong zero-shot generalization capability for unseen objects in cluttered environments, handling cases with significant initial pose deviations while maintaining high sample efficiency and requiring little human effort. In real-world experiments, with just 5 hours of training data, EasyInsert achieves over 90% success in zero-shot insertion for 13 out of 15 unseen novel objects, including challenging objects like Type-C cables, HDMI cables, and Ethernet cables. Furthermore, with only one human demonstration and 4 minutes of automatically collected data for fine-tuning, it reaches over 90% success rate for all 15 objects.

📄 PDF Abstract BibTeX arXiv:2505.16187

Code (0)

등록된 구현이 없습니다.

Tasks

Pose PredictionZero-shot Generalization

Similar Papers 제목 키워드 기반

Zero-Shot Peg Insertion: Identifying Mating Holes and Estimating SE(2) Poses with Vision-Language Models

2025-03-08 · Masaru Yajima, Kei Ota, Asako Kanezaki, Rei Kawakami

Achieving zero-shot peg insertion, where inserting an arbitrary peg into an unseen hole without task-specific training, remains a fundamental challenge in robotics. This task demands a highly generalizable perception sys…

Query-Centric Diffusion Policy for Generalizable Robotic Assembly

2025-09-23 · Ziyi Xu, Haohong Lin, Shiqi Liu, Ding Zhao arxiv

The robotic assembly task poses a key challenge in building generalist robots due to the intrinsic complexity of part interactions and the sensitivity to noise perturbations in contact-rich settings. The assembly agent i…

Insertion-Deletion Transformer

2020-01-15 · Laura Ruis, Mitchell Stern, Julia Proskurnia, William Chan

We propose the Insertion-Deletion Transformer, a novel transformer-based neural architecture and training method for sequence generation. The model consists of two phases that are executed iteratively, 1) an insertion ph…

Translation

Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptation

2022-06-06 · YiWen Chen, Xue Li, Sheng Guo, Xian Yao Ng 외

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are als…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Failure Forecasting Boosts Robustness of Sim2Real Rhythmic Insertion Policies

2025-07-09 · YuHan Liu, Xinyu Zhang, Haonan Chang, Abdeslam Boularias

This paper addresses the challenges of Rhythmic Insertion Tasks (RIT), where a robot must repeatedly perform high-precision insertions, such as screwing a nut into a bolt with a wrench. The inherent difficulty of RIT lie…

FrictionPose Tracking