Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning
Active visual tracking of space non-cooperative object is significant for future intelligent spacecraft to realise space debris removal, asteroid exploration, autonomous rendezvous and docking. However, existing works often consider this task into different subproblems (e.g. image preprocessing, feature extraction and matching, position and pose estimation, control law design) and optimize each module alone, which are trivial and sub-optimal. To this end, we propose an end-to-end active visual tracking method based on DQN algorithm, named as DRLAVT. It can guide the chasing spacecraft approach to arbitrary space non-cooperative target merely relied on color or RGBD images, which significantly outperforms position-based visual servoing baseline algorithm that adopts state-of-the-art 2D monocular tracker, SiamRPN. Extensive experiments implemented with diverse network architectures, different perturbations and multiple targets demonstrate the advancement and robustness of DRLAVT. In addition, We further prove our method indeed learnt the motion patterns of target with deep reinforcement learning through hundreds of trial-and-errors.
Code (1)
Tasks
Deep Reinforcement LearningPose EstimationPositionreinforcement-learningReinforcement LearningReinforcement Learning (RL)Visual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Learning System for Motion Planning of Free-Float Dual-Arm Space Manipulator towards Non-Cooperative Object
Recent years have seen the emergence of non-cooperative objects in space, like failed satellites and space junk. These objects are usually operated or collected by free-float dual-arm space manipulators. Thanks to elimin…
Motion PlanningObjectReinforcement Learning (RL)Trajectory PlanningCSAOT: Cooperative Multi-Agent System for Active Object Tracking
Object Tracking is essential for many computer vision applications, such as autonomous navigation, surveillance, and robotics. Unlike Passive Object Tracking (POT), which relies on static camera viewpoints to detect and …
Autonomous NavigationDeep Reinforcement LearningMixture-of-ExpertsObject+1Vision-Based Detection of Uncooperative Targets and Components on Small Satellites
Space debris and inactive satellites pose a threat to the safety and integrity of operational spacecraft and motivate the need for space situational awareness techniques. These uncooperative targets create a challenging …
Knowledge DistillationCooperative Informative Sensing for Monitoring Dynamic Indoor Environments via Multi-Agent Reinforcement Learning
Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively impr…
Multi-agent Reinforcement LearningControl of Small Spacecraft by Optimal Output Regulation: A Reinforcement Learning Approach
The growing number of noncooperative flying objects has prompted interest in sample-return and space debris removal missions. Current solutions are both costly and largely dependent on specific object identification and …
reinforcement-learning