paper-with-me

홈 › Papers

Multi-UAV Path Learning for Age and Power Optimization in IoT with UAV Battery Recharge

2023-01-09 · Eslam Eldeeb, Jean Michel de Souza Sant'Ana, Dian Echevarría Pérez, Mohammad Shehab, Nurul Huda Mahmood, Hirley Alves

In many emerging Internet of Things (IoT) applications, the freshness of the is an important design criterion. Age of Information (AoI) quantifies the freshness of the received information or status update. This work considers a setup of deployed IoT devices in an IoT network; multiple unmanned aerial vehicles (UAVs) serve as mobile relay nodes between the sensors and the base station. We formulate an optimization problem to jointly plan the UAVs' trajectory, while minimizing the AoI of the received messages and the devices' energy consumption. The solution accounts for the UAVs' battery lifetime and flight time to recharging depots to ensure the UAVs' green operation. The complex optimization problem is efficiently solved using a deep reinforcement learning algorithm. In particular, we propose a deep Q-network, which works as a function approximation to estimate the state-action value function. The proposed scheme is quick to converge and results in a lower ergodic age and ergodic energy consumption when compared with benchmark algorithms such as greedy algorithm (GA), nearest neighbour (NN), and random-walk (RW).

📄 PDF Abstract BibTeX arXiv:2301.03423

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Reinforcement Learning-based Joint Path and Energy Optimization of Cellular-Connected Unmanned Aerial Vehicles

2020-11-27 · Arash Hooshmand

Unmanned Aerial Vehicles (UAVs) have attracted considerable research interest recently. Especially when it comes to the realm of Internet of Things, the UAVs with Internet connectivity are one of the main demands. Furthe…

Q-LearningReinforcement Learning (RL)

Learning to Recharge: UAV Coverage Path Planning through Deep Reinforcement Learning

2023-09-06 · Mirco Theile, Harald Bayerlein, Marco Caccamo, Alberto L. Sangiovanni-Vincentelli

Coverage path planning (CPP) is a critical problem in robotics, where the goal is to find an efficient path that covers every point in an area of interest. This work addresses the power-constrained CPP problem with recha…

Deep Reinforcement Learningreinforcement-learning

Optimizing IoT Energy Efficiency on Edge (EEE): a Cross-layer Design in a Cognitive Mesh Network

2020-01-10

Battery-powered wireless IoT devices are now widely seen in many critical applications. Given the limited battery capacity and inaccessibility to external power recharge, optimizing energy efficiency (EE) plays a vital r…

The promise of energy-efficient battery-powered urban aircraft

2021-06-16 · Shashank Sripad, Venkatasubramanian Viswanathan

Improvements in rechargeable batteries are enabling several electric urban air mobility (UAM) aircraft designs with up to 300 miles of range with payload equivalents of up to 7 passengers. We find that novel UAM aircraft…

An Alternative Method for Solving Security-Constrained Unit Commitment with Neural Network Based Battery Degradation Model

2022-07-01 · Cunzhi Zhao, Xingpeng Li

Battery energy storage system (BESS) can effectively mitigate the uncertainty of variable renewable generation and provide flexible ancillary services. However, degradation is a key concern for rechargeable batteries suc…

Scheduling