paper-with-me

Papers

Model Predictive Control for Fluid Human-to-Robot Handovers

2022-03-31 · Wei Yang, Balakumar Sundaralingam, Chris Paxton, Iretiayo Akinola, Yu-Wei Chao, Maya Cakmak, Dieter Fox

Human-robot handover is a fundamental yet challenging task in human-robot interaction and collaboration. Recently, remarkable progressions have been made in human-to-robot handovers of unknown objects by using learning-based grasp generators. However, how to responsively generate smooth motions to take an object from a human is still an open question. Specifically, planning motions that take human comfort into account is not a part of the human-robot handover process in most prior works. In this paper, we propose to generate smooth motions via an efficient model-predictive control (MPC) framework that integrates perception and complex domain-specific constraints into the optimization problem. We introduce a learning-based grasp reachability model to select candidate grasps which maximize the robot's manipulability, giving it more freedom to satisfy these constraints. Finally, we integrate a neural net force/torque classifier that detects contact events from noisy data. We conducted human-to-robot handover experiments on a diverse set of objects with several users (N=4) and performed a systematic evaluation of each module. The study shows that the users preferred our MPC approach over the baseline system by a large margin. More results and videos are available at https://sites.google.com/nvidia.com/mpc-for-handover.

📄 PDF Abstract BibTeX arXiv:2204.00134

Code (0)

등록된 구현이 없습니다.

Tasks

Model Predictive ControlOpen-Ended Question Answering

Similar Papers 제목 키워드 기반

ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting

2023-10-20 · Kushal Kedia, Prithwish Dan, Atiksh Bhardwaj, Sanjiban Choudhury

Seamless human-robot manipulation in close proximity relies on accurate forecasts of human motion. While there has been significant progress in learning forecast models at scale, when applied to manipulation tasks, these…

Model Predictive ControlRobot Manipulation

A Virtual Mechanical Interaction Layer Enables Resilient Human-to-Robot Object Handovers

2025-11-24 · Omar Faris, Sławomir Tadeja, Fulvio Forni arxiv

Object handover is a common form of interaction that is widely present in collaborative tasks. However, achieving it efficiently remains a challenge. We address the problem of ensuring resilient robotic actions that can …

Learning Human-to-Robot Handovers from Point Clouds

2023-03-30 · CVPR 2023 1 · Sammy Christen, Wei Yang, Claudia Pérez-D'Arpino, Otmar Hilliges 외

We propose the first framework to learn control policies for vision-based human-to-robot handovers, a critical task for human-robot interaction. While research in Embodied AI has made significant progress in training rob…

YCB-Handovers Dataset: Analyzing Object Weight Impact on Human Handovers to Adapt Robotic Handover Motion

2025-12-23 · Parag Khanna, Karen Jane Dsouza, Chunyu Wang, Mårten Björkman 외 arxiv

This paper introduces the YCB-Handovers dataset, capturing motion data of 2771 human-human handovers with varying object weights. The dataset aims to bridge a gap in human-robot collaboration research, providing insights…

Object RecognitionMotion Planning

Human Grasp Classification for Reactive Human-to-Robot Handovers

2020-03-12 · Wei Yang, Chris Paxton, Maya Cakmak, Dieter Fox

Transfer of objects between humans and robots is a critical capability for collaborative robots. Although there has been a recent surge of interest in human-robot handovers, most prior research focus on robot-to-human ha…

ClassificationGeneral ClassificationObject