HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs
Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this paper, we propose a Human-Object Interaction (HOI) anticipation framework for collaborative robots. We propose an efficient and robust transformer-based model to detect and anticipate HOIs from videos. This enhanced anticipation empowers robots to proactively assist humans, resulting in more efficient and intuitive collaborations. Our model outperforms state-of-the-art results in HOI detection and anticipation in VidHOI dataset with an increase of 1.76% and 1.04% in mAP respectively while being 15.4 times faster. We showcase the effectiveness of our approach through experimental results in a real robot, demonstrating that the robot's ability to anticipate HOIs is key for better Human-Robot Interaction. More information can be found on our project webpage: https://evm7.github.io/HOI4ABOT_page/
Code (0)
등록된 구현이 없습니다.
Tasks
Human-Object Interaction AnticipationHuman-Object Interaction DetectionSimilar Papers 제목 키워드 기반
Rethinking Video Human-Object Interaction: Set Prediction over Time for Unified Detection and Anticipation
Video-based human-object interaction (HOI) understanding requires both detecting ongoing interactions and anticipating their future evolution. However, existing methods usually treat anticipation as a downstream forecast…
Representation LearningObject LocalizationStillFast: An End-to-End Approach for Short-Term Object Interaction Anticipation
Anticipation problem has been studied considering different aspects such as predicting humans' locations, predicting hands and objects trajectories, and forecasting actions and human-object interactions. In this paper, w…
Human-Object Interaction DetectionObjectShort-term Object Interaction AnticipationInteraction Region Visual Transformer for Egocentric Action Anticipation
Human-object interaction is one of the most important visual cues and we propose a novel way to represent human-object interactions for egocentric action anticipation. We propose a novel transformer variant to model inte…
Action AnticipationHuman-Object Interaction DetectionObjectAnticipation through Head Pose Estimation: a preliminary study
The ability to anticipate others' goals and intentions is at the basis of human-human social interaction. Such ability, largely based on non-verbal communication, is also a key to having natural and pleasant interactions…
Head Pose EstimationPose EstimationObject-centric Video Representation for Long-term Action Anticipation
This paper focuses on building object-centric representations for long-term action anticipation in videos. Our key motivation is that objects provide important cues to recognize and predict human-object interactions, esp…
Action AnticipationHuman-Object Interaction DetectionLong Term Action AnticipationObject+2