A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

2019-08-20 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple users attempt to access channels simultaneously. We employ the proposed framework as a single agent in the single-user case, and extend it to a decentralized multi-agent framework in the multi-user scenario. In both cases, we develop algorithms for the actor-critic deep reinforcement learning and evaluate the proposed learning policies via experiments and numerical results. In the single-user model, in order to evaluate the performance of the proposed channel access policy and the framework's tolerance against uncertainty, we explore different channel switching patterns and different switching probabilities. In the case of multiple users, we analyze the probabilities of each user accessing channels with favorable channel conditions and the probability of collision. We also address a time-varying environment to identify the adaptive ability of the proposed framework. Additionally, we provide comparisons (in terms of both the average reward and time efficiency) between the proposed actor-critic deep reinforcement learning framework, Deep-Q network (DQN) based approach, random access, and the optimal policy when the channel dynamics are known.

📄 PDF Abstract BibTeX arXiv:1908.08401

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Actor-Critic Deep Reinforcement Learning for Dynamic Multichannel Access

2018-10-08 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framewo…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Reinforcement Learning Approach for the Multichannel Rendezvous Problem

2019-07-02 · Jen-Hung Wang, Ping-En Lu, Cheng-Shang Chang, Duan-Shin Lee

In this paper, we consider the multichannel rendezvous problem in cognitive radio networks (CRNs) where the probability that two users hopping on the same channel have a successful rendezvous is a function of channel sta…

channel selection reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees

2021-05-10 · Muhammad Sohaib, Jongjin Jeong, Sang-Woon Jeon

We consider a multichannel random access system in which each user accesses a single channel at each time slot to communicate with an access point (AP). Users arrive to the system at random and be activated for a certain…

Fairness Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)+1

Semi-supervised multichannel speech enhancement with variational autoencoders and non-negative matrix factorization

2018-11-16 · Simon Leglaive, Laurent Girin, Radu Horaud

In this paper we address speaker-independent multichannel speech enhancement in unknown noisy environments. Our work is based on a well-established multichannel local Gaussian modeling framework. We propose to use a neur…

Speech Enhancement

Multichannel Compressive Sensing MRI Using Noiselet Encoding

2014-07-21 · Kamlesh Pawar, Gary F. Egan, Jingxin Zhang

The incoherence between measurement and sparsifying transform matrices and the restricted isometry property (RIP) of measurement matrix are two of the key factors in determining the performance of compressive sensing (CS…

Compressive Sensing