A multi-modal table tennis robot system
In recent years, robotic table tennis has become a popular research challenge for perception and robot control. Here, we present an improved table tennis robot system with high accuracy vision detection and fast robot reaction. Based on previous work, our system contains a KUKA robot arm with 6 DOF, with four frame-based cameras and two additional event-based cameras. We developed a novel calibration approach to calibrate this multimodal perception system. For table tennis, spin estimation is crucial. Therefore, we introduced a novel, and more accurate spin estimation approach. Finally, we show how combining the output of an event-based camera and a Spiking Neural Network (SNN) can be used for accurate ball detection.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Robotic Table Tennis with Model-Free Reinforcement Learning
We propose a model-free algorithm for learning efficient policies capable of returning table tennis balls by controlling robot joints at a rate of 100Hz. We demonstrate that evolutionary search (ES) methods acting on CNN…
modelreinforcement-learningReinforcement LearningReinforcement Learning (RL)An Event-Based Perception Pipeline for a Table Tennis Robot
Table tennis robots gained traction over the last years and have become a popular research challenge for control and perception algorithms. Fast and accurate ball detection is crucial for enabling a robotic arm to rally …
Whole Body Model Predictive Control for Spin-Aware Quadrupedal Table Tennis
Developing table tennis robots that mirror human speed, accuracy, and ability to predict and respond to the full range of ball spins remains a significant challenge for legged robots. To demonstrate these capabilities we…
Trajectory PredictionAce! Motion Planning of Professional-Level Table Tennis Serves with a Robot Arm
Table tennis, a dynamic, compact, and popular sport, has received significant attention as a robotics benchmark over the last decades. Most of the research has focused on the rally aspect - returning an incoming ball - r…
Motion PlanningSpin Detection in Robotic Table Tennis
In table tennis, the rotation (spin) of the ball plays a crucial role. A table tennis match will feature a variety of strokes. Each generates different amounts and types of spin. To develop a robot that can compete with …