paper-with-me

홈 › Papers

Joint Path planning and Power Allocation of a Cellular-Connected UAV using Apprenticeship Learning via Deep Inverse Reinforcement Learning

2023-06-15 · Alireza Shamsoshoara, Fatemeh Lotfi, Sajad Mousavi, Fatemeh Afghah, Ismail Guvenc

This paper investigates an interference-aware joint path planning and power allocation mechanism for a cellular-connected unmanned aerial vehicle (UAV) in a sparse suburban environment. The UAV's goal is to fly from an initial point and reach a destination point by moving along the cells to guarantee the required quality of service (QoS). In particular, the UAV aims to maximize its uplink throughput and minimize the level of interference to the ground user equipment (UEs) connected to the neighbor cellular BSs, considering the shortest path and flight resource limitation. Expert knowledge is used to experience the scenario and define the desired behavior for the sake of the agent (i.e., UAV) training. To solve the problem, an apprenticeship learning method is utilized via inverse reinforcement learning (IRL) based on both Q-learning and deep reinforcement learning (DRL). The performance of this method is compared to learning from a demonstration technique called behavioral cloning (BC) using a supervised learning approach. Simulation and numerical results show that the proposed approach can achieve expert-level performance. We also demonstrate that, unlike the BC technique, the performance of our proposed approach does not degrade in unseen situations.

📄 PDF Abstract BibTeX arXiv:2306.10071

Code (1)

alirezashamsoshoara/inverse-rl-apprenticeship-learning-uav-communication 공식 구현 tf

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks

2020-12-19 · Yasar Sinan Nasir, Dongning Guo

A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint sp…

Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning+1

Power Allocation for Fingerprint-Based PHY-Layer Authentication with mmWave UAV Networks

2020-11-02 · Sung Joon Maeng, Yavuz Yapıcı, İsmail Güvenç, Huaiyu Dai 외

Physical layer security (PLS) techniques can help to protect wireless networks from eavesdropper attacks. In this paper, we consider the authentication technique that uses fingerprint embedding to defend 5G cellular netw…

TAG

Underlaid FD D2D Communications in Massive MIMO Systems via Joint Beamforming and Power Allocation

2020-09-20 · Hung V. Vu, Tho Le-Ngoc

This paper studies the benefits of incorporating underlaid full-duplex (FD) device-to-device (D2D) communications into massive multiple-input-multiple-output (MIMO) downlink systems. Due to the nature of cellular downlin…

Joint Time and Power Allocation for 5G NR Unlicensed Systems

2021-04-22 · Haizhou Bao, Yiming Huo, Xiaodai Dong, Chuanhe Huang

The fifth-generation (5G) and beyond networks are designed to efficiently utilize the spectrum resources to meet various quality of service (QoS) requirements. The unlicensed frequency bands used by WiFi are mainly deplo…

Fairness

Full-Duplex ISAC-Enabled D2D Underlaid Cellular Networks: Joint Transceiver Beamforming and Power Allocation

2024-08-21 · Tao Jiang, Ming Jin, Qinghua Guo, Yinhong Liu 외

Integrating device-to-device (D2D) communication into cellular networks can significantly reduce the transmission burden on base stations (BSs). Besides, integrated sensing and communication (ISAC) is envisioned as a key…

Integrated sensing and communicationISAC