Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks
A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint spectrum and power allocation problem is often formulated to maximize a sum-rate objective. The best known algorithms for solving such problems generally require instantaneous global channel state information and a centralized optimizer. In fact those algorithms have not been implemented in practice in large networks with time-varying subbands. Deep reinforcement learning algorithms are promising tools for solving complex resource management problems. A major challenge here is that spectrum allocation involves discrete subband selection, whereas power allocation involves continuous variables. In this paper, a learning framework is proposed to optimize both discrete and continuous decision variables. Specifically, two separate deep reinforcement learning algorithms are designed to be executed and trained simultaneously to maximize a joint objective. Simulation results show that the proposed scheme outperforms both the state-of-the-art fractional programming algorithm and a previous solution based on deep reinforcement learning.
Code (1)
Tasks
Deep Reinforcement LearningManagementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Joint Time and Power Allocation for 5G NR Unlicensed Systems
The fifth-generation (5G) and beyond networks are designed to efficiently utilize the spectrum resources to meet various quality of service (QoS) requirements. The unlicensed frequency bands used by WiFi are mainly deplo…
FairnessJoint Power and Spectrum Orchestration for D2D Semantic Communication Underlying Energy-Efficient Cellular Networks
Semantic communication (SemCom) has been recently deemed a promising next-generation wireless technique to enable efficient spectrum savings and information exchanges, thus naturally introducing a novel and practical net…
ManagementSemantic CommunicationTripletChannel-Adaptive Robust Resource Allocation for Highly Reliable IRS-Assisted V2X Communications
This paper addresses the challenges of resource allocation in vehicular networks enhanced by Intelligent Reflecting Surfaces (IRS), considering the uncertain Channel State Information (CSI) typical of vehicular environme…
Self-LearningJoint Path planning and Power Allocation of a Cellular-Connected UAV using Apprenticeship Learning via Deep Inverse Reinforcement Learning
This paper investigates an interference-aware joint path planning and power allocation mechanism for a cellular-connected unmanned aerial vehicle (UAV) in a sparse suburban environment. The UAV's goal is to fly from an i…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement LearningMulti-Agent Reinforcement Learning in NOMA-aided UAV Networks for Cellular Offloading
A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs), while the non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spe…
ClusteringMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)