Reinforcement Learning for Enhancing Sensing Estimation in Bistatic ISAC Systems with UAV Swarms
This paper introduces a novel Multi-Agent Reinforcement Learning (MARL) framework to enhance integrated sensing and communication (ISAC) networks using unmanned aerial vehicle (UAV) swarms as sensing radars. By framing the positioning and trajectory optimization of UAVs as a Partially Observable Markov Decision Process, we develop a MARL approach that leverages centralized training with decentralized execution to maximize the overall sensing performance. Specifically, we implement a decentralized cooperative MARL strategy to enable UAVs to develop effective communication protocols, therefore enhancing their environmental awareness and operational efficiency. Additionally, we augment the MARL solution with a transmission power adaptation technique to mitigate interference between the communicating drones and optimize the communication protocol efficiency. Moreover, a transmission power adaptation technique is incorporated to mitigate interference and optimize the learned communication protocol efficiency. Despite the increased complexity, our solution demonstrates robust performance and adaptability across various scenarios, providing a scalable and cost-effective enhancement for future ISAC networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Integrated sensing and communicationISACMulti-agent Reinforcement LearningSimilar Papers 제목 키워드 기반
Parametrized Stacked Intelligent Metasurfaces for Bistatic Integrated Sensing and Communications
We consider stacked intelligent metasurfaces (SIMs) as a tool to improve the performance of bistatic integrated sensing and communications (ISAC) schemes. To that end, we optimize the SIMs and design a radar parameter es…
compressed sensingISACparameter estimationBistatic Sensing at THz Frequencies via a Two-Stage Ultra-Wideband MIMO-OFDM System
Only the chairs can edit The availability of abundant bandwidth at terahertz (THz) frequencies holds promise for significantly enhancing the sensing performance of integrated sensing and communication (ISAC) systems in t…
Integrated sensing and communicationISACPositionBistatic Doppler Frequency Estimation with Asynchronous Moving Devices for Integrated Sensing and Communications
In this letter, we present for the first time a method to estimate the bistatic Doppler frequency of a target with clock asynchronous and mobile Integrated Sensing And Communication (ISAC) devices. Existing approaches ha…
Integrated sensing and communicationISACBridging the Gap via Data-Aided Sensing: Can Bistatic ISAC Converge to Genie Performance?
We investigate data-aided iterative sensing in bistatic OFDM ISAC systems, focusing on scenarios with co-located sensing and communication receivers. To enhance target detection beyond pilot-only sensing methods, we prop…
ISACOFDM Based Bistatic Integrated Sensing and Communication: Sensing Beyond CP Limit
This work investigates a bistatic OFDM-based integrated sensing and communication (ISAC) system under a single-target scenario, considering both line-of-sight (LOS) presence and LOS blockage cases. A sliding window-based…
Integrated sensing and communicationISAC