MPC-based Reinforcement Learning for a Simplified Freight Mission of Autonomous Surface Vehicles
In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified freight mission, including collision-free path following, autonomous docking, and a skillful transition between them. We use a parametrized MPC-scheme to approximate the optimal policy, which considers path-following/docking costs and states (position, velocity)/inputs (thruster force, angle) constraints. The Least Squares Temporal Difference (LSTD)-based Deterministic Policy Gradient (DPG) method is then applied to update the policy parameters. Our simulation results demonstrate that the proposed MPC-LSTD-based DPG method could improve the closed-loop performance during learning for the freight mission problem of ASV.
Code (0)
등록된 구현이 없습니다.
Tasks
Model Predictive ControlPositionreinforcement-learningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Environmental injustice in America: Racial disparities in exposure to air pollution health damages from freight trucking
PM2.5 produced by freight trucks has adverse impacts on human health. However, it is unknown to what extent freight trucking affects communities of color and the total public health burden arising from the sector. Based …
Empowering Cognitive Digital Twins with Generative Foundation Models: Developing a Low-Carbon Integrated Freight Transportation System
Effective monitoring of freight transportation is essential for advancing sustainable, low-carbon economies. Traditional methods relying on single-modal data and discrete simulations fall short in optimizing intermodal s…
Data IntegrationDeepFreight: Integrating Deep Reinforcement Learning and Mixed Integer Programming for Multi-transfer Truck Freight Delivery
With the freight delivery demands and shipping costs increasing rapidly, intelligent control of fleets to enable efficient and cost-conscious solutions becomes an important problem. In this paper, we propose DeepFreight,…
Deep Reinforcement LearningMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+1Integrated optimization of railway freight operation planning and pricing based on carbon emission reduction policies
Cargo transportation is one of the major sources of carbon emissions. To reduce carbon emissions from inland freight, one way is to encourage rail transportation instead of truck transportation. In this paper, a new ap…
ManagementTruck Traffic Monitoring with Satellite Images
The road freight sector is responsible for a large and growing share of greenhouse gas emissions, but reliable data on the amount of freight that is moved on roads in many parts of the world are scarce. Many low- and mid…
object-detectionObject Detection