Solving reward-collecting problems with UAVs: a comparison of online optimization and Q-learning

2021-11-30 · Yixuan Liu, Chrysafis Vogiatzis, Ruriko Yoshida, Erich Morman

Uncrewed autonomous vehicles (UAVs) have made significant contributions to reconnaissance and surveillance missions in past US military campaigns. As the prevalence of UAVs increases, there has also been improvements in counter-UAV technology that makes it difficult for them to successfully obtain valuable intelligence within an area of interest. Hence, it has become important that modern UAVs can accomplish their missions while maximizing their chances of survival. In this work, we specifically study the problem of identifying a short path from a designated start to a goal, while collecting all rewards and avoiding adversaries that move randomly on the grid. We also provide a possible application of the framework in a military setting, that of autonomous casualty evacuation. We present a comparison of three methods to solve this problem: namely we implement a Deep Q-Learning model, an $\varepsilon$-greedy tabular Q-Learning model, and an online optimization framework. Our computational experiments, designed using simple grid-world environments with random adversaries showcase how these approaches work and compare them in terms of performance, accuracy, and computational time.

📄 PDF Abstract BibTeX arXiv:2112.00141

Code (1)

benliu31492/solving-reward-collecting-problems-with-uavs-a-comparison-of-online-optimization-and-q-learning 공식 구현 tf

Tasks

Autonomous VehiclesQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Solving Compositional Reinforcement Learning Problems via Task Reduction

2021-03-13 · ICLR 2021 1 · Yunfei Li, Yilin Wu, Huazhe Xu, Xiaolong Wang 외

We propose a novel learning paradigm, Self-Imitation via Reduction (SIR), for solving compositional reinforcement learning problems. SIR is based on two core ideas: task reduction and self-imitation. Task reduction tackl…

continuous-control Continuous Control reinforcement-learning Reinforcement Learning+1

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

2023-12-11 · Xueyuan Wang, M. Cenk Gursoy, Tugba Erpek, Yalin E. Sagduyu

Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectory in multi-UAV non-cooperative scenarios while collecting data from distributed Internet o…

Collision Avoidance Decision Making

Solving Complex Multi-UAV Mission Planning Problems using Multi-objective Genetic Algorithms

2024-02-09 · Cristian Ramirez-Atencia, Gema Bello-Orgaz, Maria D R-Moreno, David Camacho

Due to recent booming of UAVs technologies, these are being used in many fields involving complex tasks. Some of them involve a high risk to the vehicle driver, such as fire monitoring and rescue tasks, which make UAVs e…

valid

Learning Regularization Functionals for Inverse Problems: A Comparative Study

2025-10-02 · Johannes Hertrich, Hok Shing Wong, Alexander Denker, Stanislas Ducotterd 외 arxiv

In recent years, a variety of learned regularization frameworks for solving inverse problems in imaging have emerged. These offer flexible modeling together with mathematical insights. The proposed methods differ in thei…

Edge Intelligence Empowered UAVs for Automated Wind Farm Monitoring in Smart Grids

2020-09-23

With the exploitation of wind power, more turbines will be deployed at remote areas possibly with harsh working conditions (e.g., offshore wind farm). The adverse working environment may lead to massive operating and mai…