Density-Aware Reinforcement Learning to Optimise Energy Efficiency in UAV-Assisted Networks

2023-06-14 · Babatunji Omoniwa, Boris Galkin, Ivana Dusparic

Unmanned aerial vehicles (UAVs) serving as aerial base stations can be deployed to provide wireless connectivity to mobile users, such as vehicles. However, the density of vehicles on roads often varies spatially and temporally primarily due to mobility and traffic situations in a geographical area, making it difficult to provide ubiquitous service. Moreover, as energy-constrained UAVs hover in the sky while serving mobile users, they may be faced with interference from nearby UAV cells or other access points sharing the same frequency band, thereby impacting the system's energy efficiency (EE). Recent multi-agent reinforcement learning (MARL) approaches applied to optimise the users' coverage worked well in reasonably even densities but might not perform as well in uneven users' distribution, i.e., in urban road networks with uneven concentration of vehicles. In this work, we propose a density-aware communication-enabled multi-agent decentralised double deep Q-network (DACEMAD-DDQN) approach that maximises the total system's EE by jointly optimising the trajectory of each UAV, the number of connected users, and the UAVs' energy consumption while keeping track of dense and uneven users' distribution. Our result outperforms state-of-the-art MARL approaches in terms of EE by as much as 65% - 85%.

📄 PDF Abstract BibTeX arXiv:2306.08785

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

BASE 설명 없음

Optimising Energy Efficiency in UAV-Assisted Networks using Deep Reinforcement Learning

2022-04-04 · Babatunji Omoniwa, Boris Galkin, Ivana Dusparic

In this letter, we study the energy efficiency (EE) optimisation of unmanned aerial vehicles (UAVs) providing wireless coverage to static and mobile ground users. Recent multi-agent reinforcement learning approaches opti…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Multi-Agent Deep Reinforcement Learning For Optimising Energy Efficiency of Fixed-Wing UAV Cellular Access Points

2021-11-03 · Boris Galkin, Babatunji Omoniwa, Ivana Dusparic

Unmanned Aerial Vehicles (UAVs) promise to become an intrinsic part of next generation communications, as they can be deployed to provide wireless connectivity to ground users to supplement existing terrestrial networks.…

Deep Reinforcement Learning Trajectory Planning

Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN

2026-06-25 · Archer Moore, Mingming Gong, Liam Hodgkinson arxiv

Reinforcement learning from human feedback (RLHF) for 3D generation is now established across a number of works, but most existing pipelines optimise explicit surface representations, often by converting radiance fields …

Reinforcement Learning 3D Generation

Scaling up Energy-Aware Multi-Agent Reinforcement Learning for Mission-Oriented Drone Networks with Individual Reward

2026-05-24 · Changling Li, Ying Li arxiv

Multi-agent reinforcement learning (MARL) has shown wide applicability in collaborative systems such as autonomous driving and smart cities for its ability of learning through interaction. With the recent development of …

Multi-agent Reinforcement Learning Trajectory Planning Autonomous Driving

Optimisation of Resource Allocation in Heterogeneous Wireless Networks Using Deep Reinforcement Learning

2025-09-29 · Oluwaseyi Giwa, Jonathan Shock, Jaco Du Toit, Tobi Awodumila arxiv

Dynamic resource allocation in open radio access network (O-RAN) heterogeneous networks (HetNets) presents a complex optimisation challenge under varying user loads. We propose a near-real-time RAN intelligent controller…

Reinforcement Learning