Real-time Keypoints Detection for Autonomous Recovery of the Unmanned Ground Vehicle
The combination of a small unmanned ground vehicle (UGV) and a large unmanned carrier vehicle allows more flexibility in real applications such as rescue in dangerous scenarios. The autonomous recovery system, which is used to guide the small UGV back to the carrier vehicle, is an essential component to achieve a seamless combination of the two vehicles. This paper proposes a novel autonomous recovery framework with a low-cost monocular vision system to provide accurate positioning and attitude estimation of the UGV during navigation. First, we introduce a light-weight convolutional neural network called UGV-KPNet to detect the keypoints of the small UGV from the images captured by a monocular camera. UGV-KPNet is computationally efficient with a small number of parameters and provides pixel-level accurate keypoints detection results in real-time. Then, six degrees of freedom pose is estimated using the detected keypoints to obtain positioning and attitude information of the UGV. Besides, we are the first to create a large-scale real-world keypoints dataset of the UGV. The experimental results demonstrate that the proposed system achieves state-of-the-art performance in terms of both accuracy and speed on UGV keypoint detection, and can further boost the 6-DoF pose estimation for the UGV.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionPose EstimationSimilar Papers 제목 키워드 기반
RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving
In this work, we propose an efficient and accurate monocular 3D detection framework in single shot. Most successful 3D detectors take the projection constraint from the 3D bounding box to the 2D box as an important compo…
Autonomous DrivingVehicle Pose EstimationSingle-Shot 3D Detection of Vehicles from Monocular RGB Images via Geometry Constrained Keypoints in Real-Time
In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification …
2D Object Detection3D Object DetectionAutonomous DrivingObject+2Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Driving
Sharing collective perception messages (CPM) between vehicles is investigated to decrease occlusions so as to improve the perception accuracy and safety of autonomous driving. However, highly accurate data sharing and lo…
Autonomous Drivingvehicle detectionPose Estimation for Robot Manipulators via Keypoint Optimization and Sim-to-Real Transfer
Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fid…
Keypoint DetectionPose Estimation3D-FCT: Simultaneous 3D Object Detection and Tracking Using Feature Correlation
3D object detection using LiDAR data remains a key task for applications like autonomous driving and robotics. Unlike in the case of 2D images, LiDAR data is almost always collected over a period of time. However, most w…
3D Object Detection3D Object TrackingAutonomous DrivingFeature Correlation+4