paper-with-me

홈 › Papers

A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics

2024-11-08 · Puze Liu, Jonas Günster, Niklas Funk, Simon Gröger, Dong Chen, Haitham Bou-Ammar, Julius Jankowski, Ante Marić, Sylvain Calinon, Andrej Orsula, Miguel Olivares-Mendez, Hongyi Zhou, Rudolf Lioutikov, Gerhard Neumann, Amarildo Likmeta Amirhossein Zhalehmehrabi, Thomas Bonenfant, Marcello Restelli, Davide Tateo, Ziyuan Liu, Jan Peters

Machine learning methods have a groundbreaking impact in many application domains, but their application on real robotic platforms is still limited. Despite the many challenges associated with combining machine learning technology with robotics, robot learning remains one of the most promising directions for enhancing the capabilities of robots. When deploying learning-based approaches on real robots, extra effort is required to address the challenges posed by various real-world factors. To investigate the key factors influencing real-world deployment and to encourage original solutions from different researchers, we organized the Robot Air Hockey Challenge at the NeurIPS 2023 conference. We selected the air hockey task as a benchmark, encompassing low-level robotics problems and high-level tactics. Different from other machine learning-centric benchmarks, participants need to tackle practical challenges in robotics, such as the sim-to-real gap, low-level control issues, safety problems, real-time requirements, and the limited availability of real-world data. Furthermore, we focus on a dynamic environment, removing the typical assumption of quasi-static motions of other real-world benchmarks. The competition's results show that solutions combining learning-based approaches with prior knowledge outperform those relying solely on data when real-world deployment is challenging. Our ablation study reveals which real-world factors may be overlooked when building a learning-based solution. The successful real-world air hockey deployment of best-performing agents sets the foundation for future competitions and follow-up research directions.

📄 PDF Abstract BibTeX arXiv:2411.05718

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning

2024-06-01 · Andrej Orsula

In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents lea…

Deep Reinforcement LearningPosition

Robot Air Hockey: A Manipulation Testbed for Robot Learning with Reinforcement Learning

2024-05-06 · Caleb Chuck, Carl Qi, Michael J. Munje, Shuozhe Li 외

Reinforcement Learning is a promising tool for learning complex policies even in fast-moving and object-interactive domains where human teleoperation or hard-coded policies might fail. To effectively reflect this challen…

Offline RL

Temporal Hockey Action Recognition via Pose and Optical Flows

2018-12-22 · Zixi Cai, Helmut Neher, Kanav Vats, David Clausi 외

Recognizing actions in ice hockey using computer vision poses challenges due to bulky equipment and inadequate image quality. A novel two-stream framework has been designed to improve action recognition accuracy for hock…

Action RecognitionOptical Flow EstimationPose EstimationTemporal Action Localization+1

Learning Control for Air Hockey Striking using Deep Reinforcement Learning

2017-02-26 · Ayal Taitler, Nahum Shimkin

We consider the task of learning control policies for a robotic mechanism striking a puck in an air hockey game. The control signal is a direct command to the robot's motors. We employ a model free deep reinforcement lea…

Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+1

Multi Player Tracking in Ice Hockey with Homographic Projections

2024-05-22 · Harish Prakash, Jia Cheng Shang, Ken M. Nsiempba, Yuhao Chen 외

Multi Object Tracking (MOT) in ice hockey pursues the combined task of localizing and associating players across a given sequence to maintain their identities. Tracking players from monocular broadcast feeds is an import…

Graph MatchingMulti-Object TrackingObject Tracking