Actor-Critic Deep Reinforcement Learning for Dynamic Multichannel Access

2018-10-08 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framework to explore the sensing policy. To evaluate the performance of the proposed sensing policy and the framework's tolerance against uncertainty, we test the framework in scenarios with different channel switching patterns and consider different switching probabilities. Then, we consider a time-varying environment to identify the adaptive ability of the proposed framework. Additionally, we provide comparisons with the Deep-Q network (DQN) based framework proposed in [1], in terms of both average reward and the time efficiency.

📄 PDF Abstract BibTeX arXiv:1810.03695

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

2019-08-20 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees

2021-05-10 · Muhammad Sohaib, Jongjin Jeong, Sang-Woon Jeon

We consider a multichannel random access system in which each user accesses a single channel at each time slot to communicate with an access point (AP). Users arrive to the system at random and be activated for a certain…

Fairness Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)+1

A Reinforcement Learning Approach for the Multichannel Rendezvous Problem

2019-07-02 · Jen-Hung Wang, Ping-En Lu, Cheng-Shang Chang, Duan-Shin Lee

In this paper, we consider the multichannel rendezvous problem in cognitive radio networks (CRNs) where the probability that two users hopping on the same channel have a successful rendezvous is a function of channel sta…

channel selection reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Studying the Interplay Between the Actor and Critic Representations in Reinforcement Learning

2025-03-08 · Samuel Garcin, Trevor McInroe, Pablo Samuel Castro, Prakash Panangaden 외

Extracting relevant information from a stream of high-dimensional observations is a central challenge for deep reinforcement learning agents. Actor-critic algorithms add further complexity to this challenge, as it is oft…

Deep Reinforcement Learning Representation Learning

Multi-Agent Actor-Critic with Harmonic Annealing Pruning for Dynamic Spectrum Access Systems

2025-03-19 · George Stamatelis, Angelos-Nikolaos Kanatas, George C. Alexandropoulos

Multi-Agent Deep Reinforcement Learning (MADRL) has emerged as a powerful tool for optimizing decentralized decision-making systems in complex settings, such as Dynamic Spectrum Access (DSA). However, deploying deep lear…

Decision Making Deep Reinforcement Learning Network Pruning