Real-Time Multimodal Signal Processing for HRI in RoboCup: Understanding a Human Referee
Advancing human-robot communication is crucial for autonomous systems operating in dynamic environments, where accurate real-time interpretation of human signals is essential. RoboCup provides a compelling scenario for testing these capabilities, requiring robots to understand referee gestures and whistle with minimal network reliance. Using the NAO robot platform, this study implements a two-stage pipeline for gesture recognition through keypoint extraction and classification, alongside continuous convolutional neural networks (CCNNs) for efficient whistle detection. The proposed approach enhances real-time human-robot interaction in a competitive setting like RoboCup, offering some tools to advance the development of autonomous systems capable of cooperating with humans.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionSimilar Papers 제목 키워드 기반
RobocupGym: A challenging continuous control benchmark in Robocup
Reinforcement learning (RL) has progressed substantially over the past decade, with much of this progress being driven by benchmarks. Many benchmarks are focused on video or board games, and a large number of robotics be…
Board Gamescontinuous-controlContinuous ControlDiversity+3Off-Policy General Value Functions to Represent Dynamic Role Assignments in RoboCup 3D Soccer Simulation
Collecting and maintaining accurate world knowledge in a dynamic, complex, adversarial, and stochastic environment such as the RoboCup 3D Soccer Simulation is a challenging task. Knowledge should be learned in real-time …
Reinforcement LearningReinforcement Learning (RL)World KnowledgeMachine Learning for RealisticBall Detection in RoboCup SPL
In this technical report, we describe the use of a machine learning approach for detecting the realistic black and white ball currently in use in the RoboCup Standard Platform League. Our aim is to provide a ready-to-use…
BIG-bench Machine LearningAn LLM-Based Automatic Sportscast Solution for Robot Soccer Matches
RoboCup has always been a scenario to develop systems that solve real-world problems. Driven by the main goal of playing against the 2050 FIFA World Cup champions, the RoboCup Soccer leagues need to constantly measure ho…
Bold Hearts Team Description for RoboCup 2019 (Humanoid Kid Size League)
We participated in the RoboCup 2018 competition in Montreal with our newly developed BoldBot based on the Darwin-OP and mostly self-printed custom parts. This paper is about the lessons learnt from that competition and f…
Semantic Segmentation