Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning
Network energy efficiency is a main pillar in the design and operation of wireless communication systems. In this paper, we investigate a dense radio access network (dense-RAN) capable of radiated power management at the base station (BS). Aiming to improve the long-term network energy efficiency, an optimization problem is formulated by collaboratively managing multi-BSs radiated power levels with constraints on the users traffic volume and achievable rate. Considering stochastic traffic arrivals at the users and time-varying network interference, we first formulate the problem as a Markov decision process (MDP) and then develop a novel deep reinforcement learning (DRL) framework based on the cloud-RAN operation scheme. To tackle the trade-off between complexity and performance, the overall optimization of multi-BSs energy efficiency with the multiplicative complexity constraint is modeled to achieve nearoptimal performance by using a deep Q-network (DQN). In DQN,each BS first maximizes its individual energy efficiency, and then cooperates with other BSs to maximize the overall multiBSs energy efficiency. Simulation results demonstrate that the proposed algorithm can converge faster and enjoy a network energy efficiency improvement by 5% and 10% compared with the benchmarks of the Q-learning and sleep schemes, respectively.
Code (1)
Tasks
Deep Reinforcement LearningManagementQ-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
TiRE-GAN: Task-Incentivized Generative Learning for Radiomap Estimation
To characterize radio frequency (RF) signal power distribution in wireless communication systems, the radiomap is a useful tool for resource allocation and network management. Usually, a dense radiomap is reconstructed f…
ManagementBeam Management Driven by Radio Environment Maps in O-RAN Architecture
The Massive Multiple-Input Multiple-Output (M-MIMO) is considered as one of the key technologies in 5G, and future 6G networks. From the perspective of, e.g., channel estimation, especially for high-speed users it is eas…
ManagementReinforcement Learning (RL)LLM-Integrated Digital Twins for Hierarchical Resource Allocation in 6G Networks
Next-generation (NextG) wireless networks are expected to require intelligent, scalable, and context-aware radio resource management (RRM) to support ultra-dense deployments, diverse service requirements, and dynamic net…
Decision MakingManagementCell-Free Data Power Control Via Scalable Multi-Objective Bayesian Optimisation
Cell-free multi-user multiple input multiple output networks are a promising alternative to classical cellular architectures, since they have the potential to provide uniform service quality and high resource utilisation…
Bayesian OptimisationManagementCopilotCAD: Empowering Radiologists with Report Completion Models and Quantitative Evidence from Medical Image Foundation Models
Computer-aided diagnosis systems hold great promise to aid radiologists and clinicians in radiological clinical practice and enhance diagnostic accuracy and efficiency. However, the conventional systems primarily focus o…
Diagnosticimage-classificationImage ClassificationMedical Image Analysis+1