paper-with-me

홈 › Papers

Conformalized Teleoperation: Confidently Mapping Human Inputs to High-Dimensional Robot Actions

2024-06-11 · Michelle Zhao, Reid Simmons, Henny Admoni, Andrea Bajcsy

Assistive robotic arms often have more degrees-of-freedom than a human teleoperator can control with a low-dimensional input, like a joystick. To overcome this challenge, existing approaches use data-driven methods to learn a mapping from low-dimensional human inputs to high-dimensional robot actions. However, determining if such a black-box mapping can confidently infer a user's intended high-dimensional action from low-dimensional inputs remains an open problem. Our key idea is to adapt the assistive map at training time to additionally estimate high-dimensional action quantiles, and then calibrate these quantiles via rigorous uncertainty quantification methods. Specifically, we leverage adaptive conformal prediction which adjusts the intervals over time, reducing the uncertainty bounds when the mapping is performant and increasing the bounds when the mapping consistently mis-predicts. Furthermore, we propose an uncertainty-interval-based mechanism for detecting high-uncertainty user inputs and robot states. We evaluate the efficacy of our proposed approach in a 2D assistive navigation task and two 7DOF Kinova Jaco tasks involving assistive cup grasping and goal reaching. Our findings demonstrate that conformalized assistive teleoperation manages to detect (but not differentiate between) high uncertainty induced by diverse preferences and induced by low-precision trajectories in the mapping's training dataset. On the whole, we see this work as a key step towards enabling robots to quantify their own uncertainty and proactively seek intervention when needed.

📄 PDF Abstract BibTeX arXiv:2406.07767

Code (0)

등록된 구현이 없습니다.

Tasks

Conformal PredictionUncertainty Quantification

Similar Papers 제목 키워드 기반

Learning User-Preferred Mappings for Intuitive Robot Control

2020-07-22 · Mengxi Li, Dylan P. Losey, Jeannette Bohg, Dorsa Sadigh

When humans control drones, cars, and robots, we often have some preconceived notion of how our inputs should make the system behave. Existing approaches to teleoperation typically assume a one-size-fits-all approach, wh…

Robot Manipulation

Mapping Surgeon's Hand/Finger Motion During Conventional Microsurgery to Enhance Intuitive Surgical Robot Teleoperation

2021-02-21 · Mohammad Fattahi Sani, Raimondo Ascione, Sanja Dogramadzi

Purpose: Recent developments in robotics and artificial intelligence (AI) have led to significant advances in healthcare technologies enhancing robot-assisted minimally invasive surgery (RAMIS) in some surgical specialti…

Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models

2025-06-17 · Huihan Liu, Rutav Shah, Shuijing Liu, Jack Pittenger 외

Assistive teleoperation, where control is shared between a human and a robot, enables efficient and intuitive human-robot collaboration in diverse and unstructured environments. A central challenge in real-world assistiv…

CHILD (Controller for Humanoid Imitation and Live Demonstration): a Whole-Body Humanoid Teleoperation System

2025-07-31 · Noboru Myers, Obin Kwon, Sankalp Yamsani, Joohyung Kim arxiv

Recent advances in teleoperation have demonstrated robots performing complex manipulation tasks. However, existing works rarely support whole-body joint-level teleoperation for humanoid robots, limiting the diversity of …

Real-time Photorealistic Mapping for Situational Awareness in Robot Teleoperation

2025-09-08 · Ian Page, Pierre Susbielle, Olivier Aycard, Pierre-Brice Wieber arxiv

Achieving efficient remote teleoperation is particularly challenging in unknown environments, as the teleoperator must rapidly build an understanding of the site's layout. Online 3D mapping is a proven strategy to tackle…