Maneuver Decision-Making Through Automatic Curriculum Reinforcement Learning Without Handcrafted Reward functions

2023-07-12 · Zhang Hong-Peng

Maneuver decision-making is the core of unmanned combat aerial vehicle for autonomous air combat. To solve this problem, we propose an automatic curriculum reinforcement learning method, which enables agents to learn effective decisions in air combat from scratch. The range of initial states are used for distinguishing curricula of different difficulty levels, thereby maneuver decision is divided into a series of sub-tasks from easy to difficult, and test results are used to change sub-tasks. As sub-tasks change, agents gradually learn to complete a series of sub-tasks from easy to difficult, enabling them to make effective maneuvering decisions to cope with various states without the need to spend effort designing reward functions. The ablation studied show that the automatic curriculum learning proposed in this article is an essential component for training through reinforcement learning, namely, agents cannot complete effective decisions without curriculum learning. Simulation experiments show that, after training, agents are able to make effective decisions given different states, including tracking, attacking and escaping, which are both rational and interpretable.

📄 PDF Abstract BibTeX arXiv:2307.06152

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making reinforcement-learning Reinforcement Learning

Maneuver Decision-Making For Autonomous Air Combat Through Curriculum Learning And Reinforcement Learning With Sparse Rewards

2023-02-12 · Yu-Jie Wei, Hong-Peng Zhang, Chang-Qiang Huang

Reinforcement learning is an effective way to solve the decision-making problems. It is a meaningful and valuable direction to investigate autonomous air combat maneuver decision-making method based on reinforcement lear…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Tactical Decision Making for Autonomous Trucks by Deep Reinforcement Learning with Total Cost of Operation Based Reward

2024-03-11 · Deepthi Pathare, Leo Laine, Morteza Haghir Chehreghani

We develop a deep reinforcement learning framework for tactical decision making in an autonomous truck, specifically for Adaptive Cruise Control (ACC) and lane change maneuvers in a highway scenario. Our results demonstr…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios

2019-04-12 · Yeping Hu, Alireza Nakhaei, Masayoshi Tomizuka, Kikuo Fujimura

In order to drive safely and efficiently under merging scenarios, autonomous vehicles should be aware of their surroundings and make decisions by interacting with other road participants. Moreover, different strategies s…

Autonomous Vehicles Common Sense Reasoning Decision Making Multi-agent Reinforcement Learning+1

Maneuver Decision-Making Through Proximal Policy Optimization And Monte Carlo Tree Search

2023-08-28 · Zhang Hong-Peng

Maneuver decision-making can be regarded as a Markov decision process and can be address by reinforcement learning. However, original reinforcement learning algorithms can hardly solve the maneuvering decision-making pro…

Decision Making reinforcement-learning Reinforcement Learning

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

2020-08-14 · Feng Wang, Dongjie Shi, Teng Liu, Xiaolin Tang

Decision-making module enables autonomous vehicles to reach appropriate maneuvers in the complex urban environments, especially the intersection situations. This work proposes a deep reinforcement learning (DRL) based le…

Autonomous Vehicles Decision Making Deep Reinforcement Learning Q-Learning+2