paper-with-me

홈 › Papers

Realtime Spectrum Monitoring via Reinforcement Learning -- A Comparison Between Q-Learning and Heuristic Methods

2023-07-11 · Tobias Braun, Tobias Korzyzkowske, Larissa Putzar, Jan Mietzner, Peter A. Hoeher

Due to technological advances in the field of radio technology and its availability, the number of interference signals in the radio spectrum is continuously increasing. Interference signals must be detected in a timely fashion, in order to maintain standards and keep emergency frequencies open. To this end, specialized (multi-channel) receivers are used for spectrum monitoring. In this paper, the performances of two different approaches for controlling the available receiver resources are compared. The methods used for resource management (ReMa) are linear frequency tuning as a heuristic approach and a Q-learning algorithm from the field of reinforcement learning. To test the methods to be investigated, a simplified scenario was designed with two receiver channels monitoring ten non-overlapping frequency bands with non-uniform signal activity. For this setting, it is shown that the Q-learning algorithm used has a significantly higher detection rate than the heuristic approach at the expense of a smaller exploration rate. In particular, the Q-learning approach can be parameterized to allow for a suitable trade-off between detection and exploration rate.

📄 PDF Abstract BibTeX arXiv:2307.05763

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Realtime, multimodal invasive ventilation risk monitoring using language models and BoXHED

2024-09-29 · Arash Pakbin, Aaron Su, Donald K. K. Lee, Bobak J. Mortazavi

Objective: realtime monitoring of invasive ventilation (iV) in intensive care units (ICUs) plays a crucial role in ensuring prompt interventions and better patient outcomes. However, conventional methods often overlook v…

Decision MakingText Summarization

Realtime Dynamic Gaze Target Tracking and Depth-Level Estimation

2024-06-09 · Esmaeil Seraj, Harsh Bhate, Walter Talamonti

The integration of Transparent Displays (TD) in various applications, such as Heads-Up Displays (HUDs) in vehicles, is a burgeoning field, poised to revolutionize user experiences. However, this innovation brings forth s…

Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference

2024-12-18 · Matthew Riemer, Gopeshh Subbaraj, Glen Berseth, Irina Rish

Realtime environments change even as agents perform action inference and learning, thus requiring high interaction frequencies to effectively minimize regret. However, recent advances in machine learning involve larger n…

Reinforcement Learning (RL)

Sorta Solving the OPF by Not Solving the OPF: DAE Control Theory and the Price of Realtime Regulation

2023-04-07 · Muhammad Nadeem, Ahmad F. Taha

This paper presents a new approach to approximate the AC optimal power flow (ACOPF). By eliminating the need to solve the ACOPF every few minutes, the paper showcases how a realtime feedback controller can be utilized in…

HEART: A High-Efficiency Adaptive Real-Time Telemonitoring Framework for Secure Electrocardiogram Signal Transmission Using Chaotic Encryption

2026-05-08 · Beyazıt Bestami Yuksel arxiv

The realtime analysis and secure transmission of electrocardiogram ECG signals are critical for accurate diagnosis and safeguarding patient privacy in telemedicine applications This study presents a novel realtime ECG mo…