UNet-Based Keypoint Regression for 3D Cone Localization in Autonomous Racing
Accurate cone localization in 3D space is essential in autonomous racing for precise navigation around the track. Approaches that rely on traditional computer vision algorithms are sensitive to environmental variations, and neural networks are often trained on limited data and are infeasible to run in real time. We present a UNet-based neural network for keypoint detection on cones, leveraging the largest custom-labeled dataset we have assembled. Our approach enables accurate cone position estimation and the potential for color prediction. Our model achieves substantial improvements in keypoint accuracy over conventional methods. Furthermore, we leverage our predicted keypoints in the perception pipeline and evaluate the end-to-end autonomous system. Our results show high-quality performance across all metrics, highlighting the effectiveness of this approach and its potential for adoption in competitive autonomous racing systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionSimilar Papers 제목 키워드 기반
Real-time 3D Traffic Cone Detection for Autonomous Driving
Considerable progress has been made in semantic scene understanding of road scenes with monocular cameras. It is, however, mainly related to certain classes such as cars and pedestrians. This work investigates traffic co…
3D Object DetectionAutonomous DrivingAutonomous Vehiclesobject-detection+3Spatial-Aware Regression for Keypoint Localization
Regression-based keypoint localization shows advantages of high efficiency and better robustness to quantization errors than heatmap-based methods. However existing regression-based methods discard the spatial locati…
3D Pose EstimationPose EstimationQuantizationregressionLite-FPN for Keypoint-based Monocular 3D Object Detection
3D object detection with a single image is an essential and challenging task for autonomous driving. Recently, keypoint-based monocular 3D object detection has made tremendous progress and achieved great speed-accuracy t…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2OSKDet: Orientation-Sensitive Keypoint Localization for Rotated Object Detection
Rotated object detection is a challenging issue in computer vision field. Inadequate rotated representation and the confusion of parametric regression have been the bottleneck for high performance rotated detection. …
Objectobject-detectionObject DetectionregressionGraph-PCNN: Two Stage Human Pose Estimation with Graph Pose Refinement
Recently, most of the state-of-the-art human pose estimation methods are based on heatmap regression. The final coordinates of keypoints are obtained by decoding heatmap directly. In this paper, we aim to find a better a…
Pose EstimationregressionVocal Bursts Valence Prediction