Bayesian Nonparametric Modelling for Model-Free Reinforcement Learning in LTE-LAA and Wi-Fi Coexistence
With the arrival of next generation wireless communication, a growing number of new applications like internet of things, autonomous driving systems, and drone are crowding the unlicensed spectrum. Licensed network such as the long-term evolution (LTE) also comes to the unlicensed spectrum for better providing high-capacity contents with low cost. However, LTE was not designed to share resources with others. Previous solutions usually work on fixed scenarios. This work features a Nonparametric Bayesian reinforcement learning algorithm to cope with the coexistence between Wi-Fi and LTE licensed assisted access (LTE-LAA) agents in 5 GHz unlicensed spectrum. The coexistence problem is modeled as a decentralized partially-observable Markov decision process (Dec-POMDP) and Bayesian inference is adopted for policy learning with nonparametric prior to accommodate the uncertainty of policy for different agents. A fairness measure is introduced in the reward function to encourage fair sharing between agents. Variational inference for posterior model approximation is considered to make the algorithm computationally efficient. Simulation results demonstrate that this algorithm can reach high value with compact policy representations in few learning iterations.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingBayesian InferenceFairnessVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bayesian Nonparametric Reinforcement Learning in LTE and Wi-Fi Coexistence
With the formation of next generation wireless communication, a growing number of new applications like internet of things, autonomous car, and drone is crowding the unlicensed spectrum. Licensed network such as the long…
Fairnessreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Nonparametric Bayesian Topic Modelling with the Hierarchical Pitman-Yor Processes
The Dirichlet process and its extension, the Pitman-Yor process, are stochastic processes that take probability distributions as a parameter. These processes can be stacked up to form a hierarchical nonparametric Bayesia…
Topic ModelsBayesian Nonparametric Modeling of Heterogeneous Groups of Censored Data
Datasets containing large samples of time-to-event data arising from several small heterogeneous groups are commonly encountered in statistics. This presents problems as they cannot be pooled directly due to their hetero…
Resource Allocation for a Wireless Coexistence Management System Based on Reinforcement Learning
In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence.…
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Ecosystem knowledge should replace coexistence and stability assumptions in ecological network modelling
Quantitative population modelling is an invaluable tool for identifying the cascading effects of ecosystem management and interventions. Ecosystem models are often constructed by assuming stability and coexistence in eco…
Decision MakingManagement