paper-with-me

Papers

Multi-Agent Deep Reinforcement Learning For Optimising Energy Efficiency of Fixed-Wing UAV Cellular Access Points

2021-11-03 · Boris Galkin, Babatunji Omoniwa, Ivana Dusparic

Unmanned Aerial Vehicles (UAVs) promise to become an intrinsic part of next generation communications, as they can be deployed to provide wireless connectivity to ground users to supplement existing terrestrial networks. The majority of the existing research into the use of UAV access points for cellular coverage considers rotary-wing UAV designs (i.e. quadcopters). However, we expect fixed-wing UAVs to be more appropriate for connectivity purposes in scenarios where long flight times are necessary (such as for rural coverage), as fixed-wing UAVs rely on a more energy-efficient form of flight when compared to the rotary-wing design. As fixed-wing UAVs are typically incapable of hovering in place, their deployment optimisation involves optimising their individual flight trajectories in a way that allows them to deliver high quality service to the ground users in an energy-efficient manner. In this paper, we propose a multi-agent deep reinforcement learning approach to optimise the energy efficiency of fixed-wing UAV cellular access points while still allowing them to deliver high-quality service to users on the ground. In our decentralized approach, each UAV is equipped with a Dueling Deep Q-Network (DDQN) agent which can adjust the 3D trajectory of the UAV over a series of timesteps. By coordinating with their neighbours, the UAVs adjust their individual flight trajectories in a manner that optimises the total system energy efficiency. We benchmark the performance of our approach against a series of heuristic trajectory planning strategies, and demonstrate that our method can improve the system energy efficiency by as much as 70%.

📄 PDF Abstract BibTeX arXiv:2111.02258

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningTrajectory Planning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Optimising Energy Efficiency in UAV-Assisted Networks using Deep Reinforcement Learning

2022-04-04 · Babatunji Omoniwa, Boris Galkin, Ivana Dusparic

In this letter, we study the energy efficiency (EE) optimisation of unmanned aerial vehicles (UAVs) providing wireless coverage to static and mobile ground users. Recent multi-agent reinforcement learning approaches opti…

Deep Reinforcement LearningMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Density-Aware Reinforcement Learning to Optimise Energy Efficiency in UAV-Assisted Networks

2023-06-14 · Babatunji Omoniwa, Boris Galkin, Ivana Dusparic

Unmanned aerial vehicles (UAVs) serving as aerial base stations can be deployed to provide wireless connectivity to mobile users, such as vehicles. However, the density of vehicles on roads often varies spatially and tem…

Multi-agent Reinforcement Learningreinforcement-learning

Comparing Approaches to Distributed Control of Fluid Systems based on Multi-Agent Systems

2022-12-16 · Kevin T. Logan, J. Marius Stürmer, Tim M. Müller, Peter F. Pelz

Conventional control of fluid systems does not consider system-wide knowledge for optimising energy efficient operation. Distributed control of fluid systems combines reliable local control of components while using syst…

Deep Reinforcement LearningModel Predictive Control

HVAC-DPT: A Decision Pretrained Transformer for HVAC Control

2024-11-29 · Anaïs Berkes

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, o…

In-Context Reinforcement LearningReinforcement Learning (RL)

Dynamic Pricing in High-Speed Railways Using Multi-Agent Reinforcement Learning

2025-01-14 · Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, David Muñoz-Valero, Giovanni Montana 외

This paper addresses a critical challenge in the high-speed passenger railway industry: designing effective dynamic pricing strategies in the context of competing and cooperating operators. To address this, a multi-agent…

Deep Reinforcement LearningMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning