Distributed Online Learning for Coexistence in Cognitive Radar Networks
This work addresses the coexistence problem for radar networks. Specifically, we model a network of cooperative, independent, and non-communicating radar nodes which must share resources within the network as well as with non-cooperative nearby emitters. We approach this problem using online Machine Learning (ML) techniques. Online learning approaches are specifically preferred due to the fact that each radar node has no prior knowledge of the environment nor of the positions of the other radar nodes, and due to the sequential nature of the problem. For this task we specifically select the multi-player multi-armed bandit (MMAB) model, which poses the problem as a sequential game, where each radar node in a network makes independent selections of center frequency and waveform with the same goal of improving tracking performance for the network as a whole. For accurate tracking, each radar node communicates observations to a fusion center on set intervals. The fusion center has knowledge of the radar node placement, but cannot communicate to the individual nodes fast enough for waveform control. Every radar node in the network must learn the behavior of the environment, which includes rewards, interferer behavior, and target behavior. Our contributions include a mathematical description of the MMAB framework adapted to the radar network scenario. We conclude with a simulation study of several different network configurations. Experimental results show that iterative, online learning using MMAB outperforms the more traditional sense-and-avoid (SAA) and fixed-allocation approaches.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments
In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning (RL)Efficient Online Learning for Cognitive Radar-Cellular Coexistence via Contextual Thompson Sampling
This paper describes a sequential, or online, learning scheme for adaptive radar transmissions that facilitate spectrum sharing with a non-cooperative cellular network. First, the interference channel between the radar a…
Deep Reinforcement LearningThompson SamplingHeterogeneously-Distributed Joint Radar Communications: Bayesian Resource Allocation
Due to spectrum scarcity, the coexistence of radar and wireless communication has gained substantial research interest recently. Among many scenarios, the heterogeneouslydistributed joint radar-communication system is pr…
Joint Radar-CommunicationCoexistence of Communications and Cognitive MIMO Radar: Waveform Design and Prototype
New generation of radar systems will need to coexist with other radio frequency (RF) systems, anticipating their behavior and reacting appropriately to avoid interference. In light of this requirement, this paper designs…
Radar waveform designInterfering Channel Estimation in Radar-Cellular Coexistence: How Much Information Do We Need?
In this paper, we focus on the coexistence between a MIMO radar and cellular base stations. We study the interfering channel estimation, where the radar is operated in the "search and track" mode, and the BS receives the…