Experimental Analysis of Reinforcement Learning Techniques for Spectrum Sharing Radar

2020-01-06 · Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone, Kelly D. Sherbondy

In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a discussion of experiments performed on Commercial off-the-shelf (COTS) hardware. Each RL technique is evaluated in terms of convergence, radar detection performance achieved in a congested spectral environment, and the ability to share 100MHz spectrum with an uncooperative communications system. We examine policy iteration, which solves an environment posed as a Markov Decision Process (MDP) by directly solving for a stochastic mapping between environmental states and radar waveforms, as well as Deep RL techniques, which utilize a form of Q-Learning to approximate a parameterized function that is used by the radar to select optimal actions. We show that RL techniques are beneficial over a Sense-and-Avoid (SAA) scheme and discuss the conditions under which each approach is most effective.

📄 PDF Abstract BibTeX arXiv:2001.01799

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning

2024-06-11 · Zhiyu Shao, Qiong Wu, Pingyi Fan, Nan Cheng 외

This work aims to investigate semantic communication in high-speed mobile Internet of vehicles (IoV) environments, with a focus on the spectrum sharing between vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I)…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Semantic Communication

Machine Learning Towards Enabling Spectrum-as-a-Service Dynamic Sharing

2020-09-04 · Abdallah Moubayed, Tanveer Ahmed, Anwar Haque, Abdallah Shami

The growth in wireless broadband users, devices, and novel applications has led to a significant increase in the demand for new radio frequency spectrum. This is expected to grow even further given the projection that th…

BIG-bench Machine Learning

Distributed Deep Reinforcement Learning for Collaborative Spectrum Sharing

2021-04-06 · Pranav M. Pawar, Amir Leshem

Spectrum sharing among users is a fundamental problem in the management of any wireless network. In this paper, we discuss the problem of distributed spectrum collaboration without central management under general unknow…

Combinatorial Optimization Deep Reinforcement Learning Management Q-Learning+3

Intelligent Spectrum Sharing in Integrated TN-NTNs: A Hierarchical Deep Reinforcement Learning Approach

2025-03-09 · Muhammad Umer, Muhammad Ahmed Mohsin, Ali Arshad Nasir, Hatem Abou-zeid 외

Integrating non-terrestrial networks (NTNs) with terrestrial networks (TNs) is key to enhancing coverage, capacity, and reliability in future wireless communications. However, the multi-tier, heterogeneous architecture o…

Deep Reinforcement Learning Management

Spectrum Sharing using Deep Reinforcement Learning in Vehicular Networks

2024-10-16 · Riya Dinesh Deshpande, Faheem A. Khan, Qasim Zeeshan Ahmed

As the number of devices getting connected to the vehicular network grows exponentially, addressing the numerous challenges of effectively allocating spectrum in dynamic vehicular environment becomes increasingly difficu…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning