Combining Contention-Based Spectrum Access and Adaptive Modulation using Deep Reinforcement Learning
The use of unlicensed spectrum for cellular systems to mitigate spectrum scarcity has led to the development of intelligent adaptive approaches to spectrum access that improve upon traditional carrier sensing and listen-before-talk methods. We study decentralized contention-based medium access for base stations (BSs) of a single Radio Access Technology (RAT) operating on unlicensed shared spectrum. We devise a distributed deep reinforcement learning-based algorithm for both contention and adaptive modulation, modelled on a two state Markov decision process, that attempts to maximize a network-wide downlink throughput objective. Empirically, we find the (proportional fairness) reward accumulated by a policy gradient approach to be significantly higher than even a genie-aided adaptive energy detection threshold. Our approaches are further validated by improved sum and peak throughput. The scalability of our approach to large networks is demonstrated via an improved cumulative reward earned on both indoor and outdoor layouts with a large number of BSs.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningFairnessreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A Deep Reinforcement Learning Framework for Contention-Based Spectrum Sharing
The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access. We consider decentralized contention-based medium access for bas…
Deep Reinforcement LearningFairnessQ-Learningreinforcement-learning+2Distributed Proximal Policy Optimization for Contention-Based Spectrum Access
The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access that go beyond traditional carrier sensing. We develop a novel di…
FairnessContinuous Multi-Link Operation: A Contention-Free Mechanism for the Unlicensed Spectrum
This paper proposes a novel mechanism to enforce contention-free channel access in the unlicensed spectrum, as opposed to the traditional contention-based approach. To achieve this objective, we build on the Wi-Fi~7 mult…
FairnessNeural Network Cognitive Engine for Autonomous and Distributed Underlay Dynamic Spectrum Access
Two key challenges in underlay dynamic spectrum access (DSA) are how to establish an interference limit from the primary network (PN) and how cognitive radios (CRs) in the secondary network (SN) become aware of the inter…
A Differentiable Digital Twin of Distributed Link Scheduling for Contention-Aware Networking
Many routing and flow optimization problems in wired networks can be solved efficiently using minimum cost flow formulations. However, this approach does not extend to wireless multi-hop networks, where the assumptions o…