Using Deep Reinforcement Learning to Enhance Channel Sampling Patterns in Integrated Sensing and Communication
In Integrated Sensing And Communication (ISAC) systems, estimating the micro-Doppler (mD) spectrogram of a target requires combining channel estimates retrieved from communication with ad-hoc sensing packets, which cope with the sparsity of the communication traffic. Hence, the mD quality depends on the transmission strategy of the sensing packets, which is still a challenging problem with no known solutions. In this letter, we design a deep Reinforcement Learning (RL) framework that fragments such a problem into a sequence of simpler decisions and takes advantage of the mD temporal evolution for maximizing the reconstruction performance. Our method is the first that learns sampling patterns to directly optimize the mD quality, enabling the adaptation of ISAC systems to variable communication traffic. We validate the proposed approach on a dataset of real channel measurements, reaching up to 40% higher mD reconstruction accuracy and several times lower computational complexity than state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningIntegrated sensing and communicationISACReinforcement Learning (RL)Similar Papers 제목 키워드 기반
CE-FPN: Enhancing Channel Information for Object Detection
Feature pyramid network (FPN) has been an effective framework to extract multi-scale features in object detection. However, current FPN-based methods mostly suffer from the intrinsic flaw of channel reduction, which brin…
MiscellaneousObjectobject-detectionObject DetectionGCN-Driven Reinforcement Learning for Probabilistic Real-Time Guarantees in Industrial URLLC
Ensuring packet-level communication quality is vital for ultra-reliable, low-latency communications (URLLC) in large-scale industrial wireless networks. We enhance the Local Deadline Partition (LDP) algorithm by introduc…
SchedulingSPARCS: A Sparse Recovery Approach for Integrated Communication and Human Sensing in mmWave Systems
A well established method to detect and classify human movements using Millimeter-Wave ( mmWave) devices is the time-frequency analysis of the small-scale Doppler effect (termed micro-Doppler) of the different body parts…
Activity RecognitionHuman Activity RecognitionOutan: An On-Head System for Driving micro-LED Arrays Implanted in Freely Moving Mice
In the intact brain, neural activity can be recorded using sensing electrodes and manipulated using light stimulation. Silicon probes with integrated electrodes and micro-LEDs enable the detection and control of neural a…
Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning
Recently, large language models (LLMs) have shown remarkable reasoning capabilities via large-scale reinforcement learning (RL). However, leveraging the RL algorithm to empower effective multi-tool collaborative reasonin…
Reinforcement Learning (RL)