paper-with-me

Papers

Bayesian Nonparametric Modelling for Model-Free Reinforcement Learning in LTE-LAA and Wi-Fi Coexistence

2021-07-06 · Po-Kan Shih, Bahman Moraffah

With the arrival of next generation wireless communication, a growing number of new applications like internet of things, autonomous driving systems, and drone are crowding the unlicensed spectrum. Licensed network such as the long-term evolution (LTE) also comes to the unlicensed spectrum for better providing high-capacity contents with low cost. However, LTE was not designed to share resources with others. Previous solutions usually work on fixed scenarios. This work features a Nonparametric Bayesian reinforcement learning algorithm to cope with the coexistence between Wi-Fi and LTE licensed assisted access (LTE-LAA) agents in 5 GHz unlicensed spectrum. The coexistence problem is modeled as a decentralized partially-observable Markov decision process (Dec-POMDP) and Bayesian inference is adopted for policy learning with nonparametric prior to accommodate the uncertainty of policy for different agents. A fairness measure is introduced in the reward function to encourage fair sharing between agents. Variational inference for posterior model approximation is considered to make the algorithm computationally efficient. Simulation results demonstrate that this algorithm can reach high value with compact policy representations in few learning iterations.

📄 PDF Abstract BibTeX arXiv:2107.02431

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingBayesian InferenceFairnessVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Bayesian Nonparametric Reinforcement Learning in LTE and Wi-Fi Coexistence

2021-05-25 · Po-Kan Shih

With the formation of next generation wireless communication, a growing number of new applications like internet of things, autonomous car, and drone is crowding the unlicensed spectrum. Licensed network such as the long…

Fairnessreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Nonparametric Bayesian Topic Modelling with the Hierarchical Pitman-Yor Processes

2016-09-22 · Kar Wai Lim, Wray Buntine, Changyou Chen, Lan Du

The Dirichlet process and its extension, the Pitman-Yor process, are stochastic processes that take probability distributions as a parameter. These processes can be stacked up to form a hierarchical nonparametric Bayesia…

Topic Models

Bayesian Nonparametric Modeling of Heterogeneous Groups of Censored Data

2016-10-24 · Alexandre Piché, Russell Steele, Ian Shrier, Stephanie Long

Datasets containing large samples of time-to-event data arising from several small heterogeneous groups are commonly encountered in statistics. This presents problems as they cannot be pooled directly due to their hetero…

Resource Allocation for a Wireless Coexistence Management System Based on Reinforcement Learning

2018-05-24 · Philip Soeffker, Dimitri Block, Nico Wiebusch, Uwe Meier

In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence.…

Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Ecosystem knowledge should replace coexistence and stability assumptions in ecological network modelling

2024-05-01 · Sarah A. Vollert, Christopher Drovandi, Matthew P. Adams

Quantitative population modelling is an invaluable tool for identifying the cascading effects of ecosystem management and interventions. Ecosystem models are often constructed by assuming stability and coexistence in eco…

Decision MakingManagement