paper-with-me

홈 › Papers

Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning

2021-12-18 · Dong Zhou, Guanghui Sun, Wenxiao Lei

Active visual tracking of space non-cooperative object is significant for future intelligent spacecraft to realise space debris removal, asteroid exploration, autonomous rendezvous and docking. However, existing works often consider this task into different subproblems (e.g. image preprocessing, feature extraction and matching, position and pose estimation, control law design) and optimize each module alone, which are trivial and sub-optimal. To this end, we propose an end-to-end active visual tracking method based on DQN algorithm, named as DRLAVT. It can guide the chasing spacecraft approach to arbitrary space non-cooperative target merely relied on color or RGBD images, which significantly outperforms position-based visual servoing baseline algorithm that adopts state-of-the-art 2D monocular tracker, SiamRPN. Extensive experiments implemented with diverse network architectures, different perturbations and multiple targets demonstrate the advancement and robustness of DRLAVT. In addition, We further prove our method indeed learnt the motion patterns of target with deep reinforcement learning through hundreds of trial-and-errors.

📄 PDF Abstract BibTeX arXiv:2112.09854

Code (1)

dongzhou-1996/sncoat 공식 구현 pytorch

Tasks

Deep Reinforcement LearningPose EstimationPositionreinforcement-learningReinforcement LearningReinforcement Learning (RL)Visual Tracking

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Similar Papers 제목 키워드 기반

A Learning System for Motion Planning of Free-Float Dual-Arm Space Manipulator towards Non-Cooperative Object

2022-07-06 · Shengjie Wang, Yuxue Cao, Xiang Zheng, Tao Zhang

Recent years have seen the emergence of non-cooperative objects in space, like failed satellites and space junk. These objects are usually operated or collected by free-float dual-arm space manipulators. Thanks to elimin…

Motion PlanningObjectReinforcement Learning (RL)Trajectory Planning

CSAOT: Cooperative Multi-Agent System for Active Object Tracking

2025-01-23 · Hy Nguyen, Bao Pham, Hung Du, Srikanth Thudumu 외

Object Tracking is essential for many computer vision applications, such as autonomous navigation, surveillance, and robotics. Unlike Passive Object Tracking (POT), which relies on static camera viewpoints to detect and …

Autonomous NavigationDeep Reinforcement LearningMixture-of-ExpertsObject+1

Vision-Based Detection of Uncooperative Targets and Components on Small Satellites

2024-08-22 · Hannah Grauer, Elena-Sorina Lupu, Connor Lee, Soon-Jo Chung 외

Space debris and inactive satellites pose a threat to the safety and integrity of operational spacecraft and motivate the need for space situational awareness techniques. These uncooperative targets create a challenging …

Knowledge Distillation

Cooperative Informative Sensing for Monitoring Dynamic Indoor Environments via Multi-Agent Reinforcement Learning

2026-04-25 · Kanghoon Lee, Matthew M. Sato, Jinnyeong Yang, Seungro Lee 외 arxiv

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively impr…

Multi-agent Reinforcement Learning

Control of Small Spacecraft by Optimal Output Regulation: A Reinforcement Learning Approach

2023-07-18 · Joao Leonardo Silva Cotta, Omar Qasem, Paula do Vale Pereira, Hector Gutierrez

The growing number of noncooperative flying objects has prompted interest in sample-return and space debris removal missions. Current solutions are both costly and largely dependent on specific object identification and …

reinforcement-learning