paper-with-me

홈 › Papers

Augmented Reality-Enhanced Robot Teleoperation for Collecting User Demonstrations

2025-09-15 · Shiqi Gong, Sebastian Zudaire, Chi Zhang, Zhen Li arxiv

Traditional industrial robot programming is often complex and time-consuming, typically requiring weeks or even months of effort from expert programmers. Although Programming by Demonstration (PbD) offers a more accessible alternative, intuitive interfaces for robot control and demonstration collection remain challenging. To address this, we propose an Augmented Reality (AR)-enhanced robot teleoperation system that integrates AR-based control with spatial point cloud rendering, enabling intuitive, contact-free demonstrations. This approach allows operators to control robots remotely without entering the workspace or using conventional tools like the teach pendant. The proposed system is generally applicable and has been demonstrated on ABB robot platforms, specifically validated with the IRB 1200 industrial robot and the GoFa 5 collaborative robot. A user study evaluates the impact of real-time environmental perception, specifically with and without point cloud rendering, on task completion accuracy, efficiency, and user confidence. Results indicate that enhanced perception significantly improves task performance by 28% and enhances user experience, as reflected by a 12% increase in the System Usability Scale (SUS) score. This work contributes to the advancement of intuitive robot teleoperation, AR interface design, environmental perception, and teleoperation safety mechanisms in industrial settings for demonstration collection. The collected demonstrations may serve as valuable training data for machine learning applications.

📄 PDF Abstract BibTeX arXiv:2509.11783

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Observer Design for Augmented Reality-based Teleoperation of Soft Robots

2026-03-05 · Jorge Francisco García-Samartín, Iago López Pérez, Emirhan Yolcu, Jaime del Cerro 외 arxiv

Although virtual and augmented reality are gaining traction as teleoperation tools for various types of robots, including manipulators and mobile robots, they are not being used for soft robots. The inherent difficulties…

OpenVR: Teleoperation for Manipulation

2023-05-16 · Abraham George, Alison Bartsch, Amir Barati Farimani

Across the robotics field, quality demonstrations are an integral part of many control pipelines. However, collecting high-quality demonstration trajectories remains time-consuming and difficult, often resulting in the n…

Self-supervised 6-DoF Robot Grasping by Demonstration via Augmented Reality Teleoperation System

2024-04-03 · Xiwen Dengxiong, Xueting Wang, Shi Bai, Yunbo Zhang

Most existing 6-DoF robot grasping solutions depend on strong supervision on grasp pose to ensure satisfactory performance, which could be laborious and impractical when the robot works in some restricted area. To this e…

Visualizing Impedance Control in Augmented Reality for Teleoperation: Design and User Evaluation

2026-03-26 · Gijs van den Brandt, Femke van Beek, Elena Torta arxiv

Teleoperation for contact-rich manipulation remains challenging, especially when using low-cost, motion-only interfaces that provide no haptic feedback. Virtual reality controllers enable intuitive motion control but do …

A High-Fidelity Robotic Manipulator Teleoperation Framework for Human-Centered Augmented Reality Evaluation

2026-02-06 · Harsh Chhajed, Tian Guo arxiv

Validating Augmented Reality (AR) tracking and interaction models requires precise, repeatable ground-truth motion. However, human users cannot reliably perform consistent motion due to biomechanical variability. Robotic…