A Generative System for Robot-to-Human Handovers: from Intent Inference to Spatial Configuration Imagery
We propose a novel system for robot-to-human object handover that emulates human coworker interactions. Unlike most existing studies that focus primarily on grasping strategies and motion planning, our system focus on 1. inferring human handover intents, 2. imagining spatial handover configuration. The first one integrates multimodal perception-combining visual and verbal cues-to infer human intent. The second one using a diffusion-based model to generate the handover configuration, involving the spacial relationship among robot's gripper, the object, and the human hand, thereby mimicking the cognitive process of motor imagery. Experimental results demonstrate that our approach effectively interprets human cues and achieves fluent, human-like handovers, offering a promising solution for collaborative robotics. Code, videos, and data are available at: https://i3handover.github.io.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion PlanningMotor ImageryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Human Grasp Classification for Reactive Human-to-Robot Handovers
Transfer of objects between humans and robots is a critical capability for collaborative robots. Although there has been a recent surge of interest in human-robot handovers, most prior research focus on robot-to-human ha…
ClassificationGeneral ClassificationObjectPreemptive Motion Planning for Human-to-Robot Indirect Placement Handovers
As technology advances, the need for safe, efficient, and collaborative human-robot-teams has become increasingly important. One of the most fundamental collaborative tasks in any setting is the object handover. Human-to…
Motion PlanningObjectYCB-Handovers Dataset: Analyzing Object Weight Impact on Human Handovers to Adapt Robotic Handover Motion
This paper introduces the YCB-Handovers dataset, capturing motion data of 2771 human-human handovers with varying object weights. The dataset aims to bridge a gap in human-robot collaboration research, providing insights…
Object RecognitionMotion PlanningR2HandoverSim: A Simulation Framework and Benchmark for Robot-to-Human Object Handovers
We present R2HandoverSim, a simulation benchmark for robot-to-human (R2H) object handovers. Although R2H handover methods have advanced rapidly, the lack of standardized evaluation protocols impedes objective comparison.…
Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers
Bimanual handovers are crucial for transferring large, deformable or delicate objects. This paper proposes a framework for generating kinematically constrained human-like bimanual robot motions to ensure seamless and nat…