paper-with-me

Papers

SpikePingpong: High-Frequency Spike Vision-based Robot Learning for Precise Striking in Table Tennis Game

2025-06-07 · Hao Wang, Chengkai Hou, Xianglong Li, Yankai Fu, Chenxuan Li, Ning Chen, Gaole Dai, Jiaming Liu, Tiejun Huang, Shanghang Zhang

Learning to control high-speed objects in the real world remains a challenging frontier in robotics. Table tennis serves as an ideal testbed for this problem, demanding both rapid interception of fast-moving balls and precise adjustment of their trajectories. This task presents two fundamental challenges: it requires a high-precision vision system capable of accurately predicting ball trajectories, and it necessitates intelligent strategic planning to ensure precise ball placement to target regions. The dynamic nature of table tennis, coupled with its real-time response requirements, makes it particularly well-suited for advancing robotic control capabilities in fast-paced, precision-critical domains. In this paper, we present SpikePingpong, a novel system that integrates spike-based vision with imitation learning for high-precision robotic table tennis. Our approach introduces two key attempts that directly address the aforementioned challenges: SONIC, a spike camera-based module that achieves millimeter-level precision in ball-racket contact prediction by compensating for real-world uncertainties such as air resistance and friction; and IMPACT, a strategic planning module that enables accurate ball placement to targeted table regions. The system harnesses a 20 kHz spike camera for high-temporal resolution ball tracking, combined with efficient neural network models for real-time trajectory correction and stroke planning. Experimental results demonstrate that SpikePingpong achieves a remarkable 91% success rate for 30 cm accuracy target area and 71% in the more challenging 20 cm accuracy task, surpassing previous state-of-the-art approaches by 38% and 37% respectively. These significant performance improvements enable the robust implementation of sophisticated tactical gameplay strategies, providing a new research perspective for robotic control in high-speed dynamic tasks.

📄 PDF Abstract BibTeX arXiv:2506.06690

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Neural NetworkFrictionImitation Learning

Similar Papers 제목 키워드 기반

High-speed and High-quality Vision Reconstruction of Spike Camera with Spike Stability Theorem

2024-12-16 · Wei zhang, Weiquan Yan, Yun Zhao, Wenxiang Cheng 외

Neuromorphic vision sensors, such as the dynamic vision sensor (DVS) and spike camera, have gained increasing attention in recent years. The spike camera can detect fine textures by mimicking the fovea in the human visua…

SpikeCV: Open a Continuous Computer Vision Era

2023-03-21 · Yajing Zheng, Jiyuan Zhang, Rui Zhao, Jianhao Ding 외

SpikeCV is a new open-source computer vision platform for the spike camera, which is a neuromorphic visual sensor that has developed rapidly in recent years. In the spike camera, each pixel position directly accumulates …

FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation

2026-02-27 · Yao Li, Peiyuan Tang, Wuyang Zhang, Chengyang Zhu 외 arxiv

Force/torque feedback can substantially improve Vision-Language-Action (VLA) models on contact-rich manipulation, but most existing approaches fuse all modalities at a single operating frequency. This design ignores the …

Recurrent Spike-based Image Restoration under General Illumination

2023-08-06 · Lin Zhu, Yunlong Zheng, Mengyue Geng, Lizhi Wang 외

Spike camera is a new type of bio-inspired vision sensor that records light intensity in the form of a spike array with high temporal resolution (20,000 Hz). This new paradigm of vision sensor offers significant advantag…

DenoisingImage ReconstructionImage Restoration

Spike-NeRF: Neural Radiance Field Based On Spike Camera

2024-03-25 · Yijia Guo, Yuanxi Bai, Liwen Hu, Mianzhi Liu 외

As a neuromorphic sensor with high temporal resolution, spike cameras offer notable advantages over traditional cameras in high-speed vision applications such as high-speed optical estimation, depth estimation, and objec…

3D ReconstructionDepth EstimationNeRFObject Tracking