Autonomous Satellite Docking via Adaptive Optimal Output Rregulation: A Reinforcement Learning Approach
This paper describes an online off-policy data-driven reinforcement learning based-algorithm to regulate and control the relative position of a deputy satellite in an autonomous satellite docking problem. The optimal control policy is learned under the framework of output regulation problem and adaptive dynamic programming (ADP) by considering the continuous-time linearized model of the satellite. The linearized model of relative motion is used to describe the motion between satellites, and the satellite docking problem is formulated as a linear optimal output regulation problem, in which the feedback-forward optimal controller is used to track a class of references and rejecting a class of disturbances while maintaining the overall system's closed-loop stability. The optimal control problem is presented using a data-driven reinforcement learning based method to regulate the relative position and velocity of the deputy to safely dock with the chief. Using the adaptive optimal output regulation framework, the learned optimal feedback-feedforward gains guarantee optimal transient and steady state performances without any prior knowledge of the dynamics of the studied system. {The states/input information of the underlying dynamical system are instead used to compute the approximated optimal feedback-feedforward control gain matrices.} Reference tracking and disturbance rejection are achieved in an optimal sense without using any modelling information of the physics of the satellites. {Simulation results are presented and demonstrate the efficacy of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Positionreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Time-Constrained Model Predictive Control for Autonomous Satellite Rendezvous, Proximity Operations, and Docking
This paper presents a time-constrained model predictive control strategy for the six degree-of-freedom autonomous rendezvous, proximity, operations and docking problem between a controllable "deputy" satellite and an unc…
Model Predictive ControlMPC-based Deep Reinforcement Learning Method for Space Robotic Control with Fuel Sloshing Mitigation
This paper presents an integrated Reinforcement Learning (RL) and Model Predictive Control (MPC) framework for autonomous satellite docking with a partially filled fuel tank. Traditional docking control faces challenges …
Reinforcement LearningSafe Autonomous Docking Maneuvers for a Floating Platform based on Input Sharing Control Barrier Functions
In this article, we present a control strategy for the problem of safe autonomous docking for a planar floating platform (Slider) that emulates the movement of a satellite. Employing the proposed strategy, Slider approac…
Coupled Rendezvous and Docking Maneuver control of satellite using Reinforcement learning-based Adaptive Fixed-Time Sliding Mode Controller
Satellite dynamics in unknown environments are inherently uncertain due to factors such as varying gravitational fields, atmospheric drag, and unpredictable interactions with space debris or other celestial bodies. Tradi…
reinforcement-learningReinforcement LearningAutonomous docking using direct optimal control
We propose a method for performing autonomous docking of marine vessels using numerical optimal control. The task is framed as a dynamic positioning problem, with the addition of spatial constraints that ensure collision…
Collision Avoidance