Multi-Access Communications with Energy Harvesting: A Multi-Armed Bandit Model and the Optimality of the Myopic Policy
A multi-access wireless network with N transmitting nodes, each equipped with an energy harvesting (EH) device and a rechargeable battery of finite capacity, is studied. At each time slot (TS) a node is operative with a certain probability, which may depend on the availability of data, or the state of its channel. The energy arrival process at each node is modelled as an independent two-state Markov process, such that, at each TS, a node either harvests one unit of energy, or none. At each TS a subset of the nodes is scheduled by the access point (AP). The scheduling policy that maximises the total throughput is studied assuming that the AP does not know the states of either the EH processes or the batteries. The problem is identified as a restless multiarmed bandit (RMAB) problem, and an upper bound on the optimal scheduling policy is found. Under certain assumptions regarding the EH processes and the battery sizes, the optimality of the myopic policy (MP) is proven. For the general case, the performance of MP is compared numerically to the upper bound.
Code (0)
등록된 구현이 없습니다.
Tasks
SchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Sum-Rate Maximization of RSMA-based Aerial Communications with Energy Harvesting: A Reinforcement Learning Approach
In this letter, we investigate a joint power and beamforming design problem for rate-splitting multiple access (RSMA)-based aerial communications with energy harvesting, where a self-sustainable aerial base station serve…
Deep Reinforcement LearningRevisiting Transmission Scheduling in RF Energy Harvesting Wireless Communications
The transmission scheduling is a critical problem in radio frequency (RF) energy harvesting communications. Existing transmission strategies in an RF-based energy harvesting system is mainly based on a classic model, in …
SchedulingModeling and Analysis of Energy Harvesting and Smart Grid-Powered Wireless Communication Networks: A Contemporary Survey
The advancements in smart power grid and the advocation of ``green communications'' have inspired the wireless communication networks to harness energy from ambient environments and operate in an energy-efficient manner …
energy tradingOnline Resource Management in Energy Harvesting BS Sites through Prediction and Soft-Scaling of Computing Resources
Multi-Access Edge Computing (MEC) is a paradigm for handling delay sensitive services that require ultra-low latency at the access network. With it, computing and communications are performed within one Base Station (BS)…
Edge-computingenergy managementManagementArtificial Noise Aided Secure Cognitive Beamforming for Cooperative MISO-NOMA Using SWIPT
Cognitive radio (CR) and non-orthogonal multiple access (NOMA) have been deemed two promising technologies due to their potential to achieve high spectral efficiency and massive connectivity. This paper studies a multipl…