Deadline-Constrained Opportunistic Spectrum Access With Spectrum Handoff
This paper considers designing an optimal policy for deadline-constrained access in cognitive radio networks, where a secondary user needs to complete a packet transmission over the vacant spectrum within a delivery deadline. To minimize the total access cost, it is desirable to design an optimal opportunistic access policy by utilizing channel dynamics and sensing outcomes. We take non-negligible switching overheads, a state-dependent overtime penalty, and practical switching operations into consideration in the Markov decision process formulation of such an access problem under wide-band sensing. Moreover, we establish the existence of monotone optimal decision rules to reduce the complexity of computing an optimal policy. Simulation results verify our theoretical studies and the cost advantage over other policies.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Reinforcement Learning with Budget-Constrained Nonparametric Function Approximation for Opportunistic Spectrum Access
Opportunistic spectrum access is one of the emerging techniques for maximizing throughput in congested bands and is enabled by predicting idle slots in spectrum. We propose a kernel-based reinforcement learning approach …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Low-Latency Task-Oriented Image Transmission with Opportunistic Spectrum Access
Communication systems designed for reliable data reconstruction, rather than task-oriented communication, typically rely on separate source and channel coding and incur high latency under limited spectrum availability an…
Medium Access Control protocol for Collaborative Spectrum Learning in Wireless Networks
In recent years there is a growing effort to provide learning algorithms for spectrum collaboration. In this paper we present a medium access control protocol which allows spectrum collaboration with minimal regret and h…
SchedulingAchievable Rates of Opportunistic Cognitive Radio Systems Using Reconfigurable Antennas with Imperfect Sensing and Channel Estimation
We consider an opportunistic cognitive radio (CR) system in which secondary transmitter (SUtx) is equipped with a reconfigurable antenna (RA). Utilizing the beam steering capability of the RA, we regard a design framewor…
Multi-Agent Hybrid SAC for Joint SS-DSA in CRNs
Opportunistic spectrum access has the potential to increase the efficiency of spectrum utilization in cognitive radio networks (CRNs). In CRNs, both spectrum sensing and resource allocation (SSRA) are critical to maximiz…
Multi-agent Reinforcement Learning