Reinforcement Learning-based Joint Path and Energy Optimization of Cellular-Connected Unmanned Aerial Vehicles

2020-11-27 · Arash Hooshmand

Unmanned Aerial Vehicles (UAVs) have attracted considerable research interest recently. Especially when it comes to the realm of Internet of Things, the UAVs with Internet connectivity are one of the main demands. Furthermore, the energy constraint i.e. battery limit is a bottle-neck of the UAVs that can limit their applications. We try to address and solve the energy problem. Therefore, a path planning method for a cellular-connected UAV is proposed that will enable the UAV to plan its path in an area much larger than its battery range by getting recharged in certain positions equipped with power stations (PSs). In addition to the energy constraint, there are also no-fly zones; for example, due to Air to Air (A2A) and Air to Ground (A2G) interference or for lack of necessary connectivity that impose extra constraints in the trajectory optimization of the UAV. No-fly zones determine the infeasible areas that should be avoided. We have used a reinforcement learning (RL) hierarchically to extend typical short-range path planners to consider battery recharge and solve the problem of UAVs in long missions. The problem is simulated for the UAV that flies over a large area, and Q-learning algorithm could enable the UAV to find the optimal path and recharge policy.

📄 PDF Abstract BibTeX arXiv:2011.13744

Code (0)

등록된 구현이 없습니다.

Tasks

Q-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Path Design for Cellular-Connected UAV with Reinforcement Learning

2019-05-09 · Yong Zeng, Xiaoli Xu

This paper studies the path design problem for cellular-connected unmanned aerial vehicle (UAV), which aims to minimize its mission completion time while maintaining good connectivity with the cellular network. We first …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Joint Path planning and Power Allocation of a Cellular-Connected UAV using Apprenticeship Learning via Deep Inverse Reinforcement Learning

2023-06-15 · Alireza Shamsoshoara, Fatemeh Lotfi, Sajad Mousavi, Fatemeh Afghah 외

This paper investigates an interference-aware joint path planning and power allocation mechanism for a cellular-connected unmanned aerial vehicle (UAV) in a sparse suburban environment. The UAV's goal is to fly from an i…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning

RL-Based Cargo-UAV Trajectory Planning and Cell Association for Minimum Handoffs, Disconnectivity, and Energy Consumption

2023-12-05 · Nesrine Cherif, Wael Jaafar, Halim Yanikomeroglu, Abbas Yongacoglu

Unmanned aerial vehicle (UAV) is a promising technology for last-mile cargo delivery. However, the limited on-board battery capacity, cellular unreliability, and frequent handoffs in the airspace are the main obstacles t…

Reinforcement Learning (RL)Trajectory Planning

Joint Optimization of Age of Information and Energy Consumption in NR-V2X System based on Deep Reinforcement Learning

2024-07-11 · Shulin Song, Zheng Zhang, Qiong Wu, Qiang Fan 외

Autonomous driving may be the most important application scenario of next generation, the development of wireless access technologies enabling reliable and low-latency vehicle communication becomes crucial. To address th…

Autonomous Driving Deep Reinforcement Learning

Reinforcement Learning-Based Energy-Aware Coverage Path Planning for Precision Agriculture

2026-01-23 · Beining Wu, Zihao Ding, Leo Ostigaard, Jun Huang arxiv

Coverage Path Planning (CPP) is a fundamental capability for agricultural robots; however, existing solutions often overlook energy constraints, resulting in incomplete operations in large-scale or resource-limited envir…

Reinforcement Learning