A Goal-Oriented Reinforcement Learning-Based Path Planning Algorithm for Modular Self-Reconfigurable Satellites

2025-05-04 · Bofei Liu, Dong Ye, Zunhao Yao, Zhaowei Sun

Modular self-reconfigurable satellites refer to satellite clusters composed of individual modular units capable of altering their configurations. The configuration changes enable the execution of diverse tasks and mission objectives. Existing path planning algorithms for reconfiguration often suffer from high computational complexity, poor generalization capability, and limited support for diverse target configurations. To address these challenges, this paper proposes a goal-oriented reinforcement learning-based path planning algorithm. This algorithm is the first to address the challenge that previous reinforcement learning methods failed to overcome, namely handling multiple target configurations. Moreover, techniques such as Hindsight Experience Replay and Invalid Action Masking are incorporated to overcome the significant obstacles posed by sparse rewards and invalid actions. Based on these designs, our model achieves a 95% and 73% success rate in reaching arbitrary target configurations in a modular satellite cluster composed of four and six units, respectively.

📄 PDF Abstract BibTeX arXiv:2505.01966

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path

2020-03-03 · Kei Ota, Yoko SASAKI, Devesh K. Jha, Yusuke Yoshiyasu 외

In this paper, we consider the problem of building learning agents that can efficiently learn to navigate in constrained environments. The main goal is to design agents that can efficiently learn to understand and genera…

Efficient Exploration Navigate reinforcement-learning Reinforcement Learning+1

Do Deep Reinforcement Learning Algorithms really Learn to Navigate?

2018-01-01 · ICLR 2018 1 · Shurjo Banerjee, Vikas Dhiman, Brent Griffin, Jason J. Corso

Deep reinforcement learning (DRL) algorithms have demonstrated progress in learning to find a goal in challenging environments. As the title of the paper by Mirowski et al. (2016) suggests, one might assume that DRL-base…

Deep Reinforcement Learning Navigate reinforcement-learning Reinforcement Learning+1

Robot path planning using deep reinforcement learning

2023-02-17 · Miguel Quinones-Ramirez, Jorge Rios-Martinez, Victor Uc-Cetina

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. Howe…

Autonomous Navigation Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Hierarchical Object-Oriented POMDP Planning for Object Rearrangement

2024-12-02 · Rajesh Mangannavar, Alan Fern, Prasad Tadepalli

We present an online planning framework for solving multi-object rearrangement problems in partially observable, multi-room environments. Current object rearrangement solutions, primarily based on Reinforcement Learning …

Object Object Rearrangement

Graph-Enhanced Exploration for Goal-oriented Reinforcement Learning

2021-09-29 · ICLR 2022 4 · Jiarui Jin, Sijin Zhou, Weinan Zhang, Tong He 외

Goal-oriented Reinforcement Learning (GoRL) is a promising approach for scaling up RL techniques on sparse reward environments requiring long horizon planning. Recent works attempt to build suitable abstraction graph of …

continuous-control Continuous Control graph construction reinforcement-learning+2