paper-with-me

Papers

Deep Reinforcement Learning for Distributed and Uncoordinated Cognitive Radios Resource Allocation

2022-05-27 · Ankita Tondwalkar, Andres Kwasinski

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may lead to a non-stationary environment. The resource allocation technique presented in this work is distributed, not requiring coordination with other agents. It is shown by considering aspects specific to deep reinforcement learning that the presented algorithm converges in an arbitrarily long time to equilibrium policies in a non-stationary multi-agent environment that results from the uncoordinated dynamic interaction between radios through the shared wireless environment. Simulation results show that the presented technique achieves a faster learning performance compared to an equivalent table-based Q-learning algorithm and is able to find the optimal policy in 99% of cases for a sufficiently long learning time. In addition, simulations show that our DQL approach requires less than half the number of learning steps to achieve the same performance as an equivalent table-based implementation. Moreover, it is shown that the use of a standard single-agent deep reinforcement learning approach may not achieve convergence when used in an uncoordinated interacting multi-radio scenario

📄 PDF Abstract BibTeX arXiv:2205.13944

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Deep Reinforcement Learning for Distributed Uncoordinated Cognitive Radios Resource Allocation

2019-10-29 · Ankita Tondwalkar, Dr Andres Kwasinski

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network that coexists through underlay dynamic spectrum access (D…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

MR-iNet Gym: Framework for Edge Deployment of Deep Reinforcement Learning on Embedded Software Defined Radio

2022-04-09 · Jithin Jagannath, Kian Hamedani, Collin Farquhar, Keyvan Ramezanpour 외

Dynamic resource allocation plays a critical role in the next generation of intelligent wireless communication systems. Machine learning has been leveraged as a powerful tool to make strides in this domain. In most cases…

Deep Reinforcement LearningGPUOpenAI Gym

Smoothing Deep Reinforcement Learning for Power Control for Spectrum Sharing in Cognitive Radios

2020-12-14 · CUHK Course IERG5350 2020 12 · Wanli Wang

The spectrum sharing in a cognitive radio system is related with a secondary user sharing common spectrum with a primary user for power transmit without induc- ing harmful inference. The deep reinforcement learning has b…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Destination-Feedback Free Distributed Transmit Beamforming using Guided Directionality

2021-08-04 · Samer Hanna, Enes Krijestorac, Danijela Cabric

Distributed transmit beamforming enables cooperative radios to act as one virtual antenna array, extending their communications' range beyond the capabilities of a single radio. Most existing distributed beamforming appr…

Distributed Transmit Beamforming: Design and Demonstration from the Lab to UAVs

2021-10-26 · Samer Hanna, Danijela Cabric

Cooperating radios can extend their communication range by adjusting their signals to ensure coherent combining at a destination radio. This technique is called distributed transmit beamforming. Beamforming (BF) relies o…