paper-with-me

Papers

Proximal Policy Optimization for Integrated Sensing and Communication in mmWave Systems

2023-06-27 · Cristian J. Vaca-Rubio, Carles Navarro Manchón, Ramoni Adeogun, Petar Popovski

In wireless communication systems, mmWave beam tracking is a critical task that affects both sensing and communications, as it is related to the knowledge of the wireless channel. We consider a setup in which a Base Station (BS) needs to dynamically choose whether the resource will be allocated for one of the three operations: sensing (beam tracking), downlink, or uplink transmission. We devise an approach based on the Proximal Policy Optimization (PPO) algorithm for choosing the resource allocation and beam tracking at a given time slot. The proposed framework takes into account the variable quality of the wireless channel and optimizes the decisions in a coordinated manner. Simulation results demonstrate that the proposed method achieves significant performance improvements in terms of average packet error rate (PER) compared to the baseline methods while providing a significant reduction in beam tracking overhead. We also show that our proposed PPO-based framework provides an effective solution to the resource allocation problem in beam tracking and communication, exhibiting a great generalization performance regardless of the stochastic behavior of the system.

📄 PDF Abstract BibTeX arXiv:2306.15429

Code (0)

등록된 구현이 없습니다.

Tasks

Integrated sensing and communication

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Adaptive Digital Twin for UAV-Assisted Integrated Sensing, Communication, and Computation Networks

2023-10-26 · Bin Li, Wenshuai Liu, Wancheng Xie, Ning Zhang 외

In this paper, we study a digital twin (DT)-empowered integrated sensing, communication, and computation network. Specifically, the users perform radar sensing and computation offloading on the same spectrum, while unman…

Edge-computing

Proximal Policy Optimization-based Transmit Beamforming and Phase-shift Design in an IRS-aided ISAC System for the THz Band

2022-03-21 · Xiangnan Liu, Haijun Zhang, Keping Long, Mingyu Zhou 외

In this paper, an IRS-aided integrated sensing and communications (ISAC) system operating in the terahertz (THz) band is proposed to maximize the system capacity. Transmit beamforming and phase-shift design are transform…

ISAC

Joint Sensing and Communication Optimization in Target-Mounted STARS-Assisted Vehicular Networks: A MADRL Approach

2023-11-17 · Haocheng Zhang, Rang Liu, Ming Li, Wei Wang 외

The utilization of integrated sensing and communication (ISAC) technology has the potential to enhance the communication performance of road side units (RSUs) through the active sensing of target vehicles. Furthermore, i…

Beam PredictionDecision MakingDeep Reinforcement LearningIntegrated sensing and communication+1

Sum Rate Enhancement using Machine Learning for Semi-Self Sensing Hybrid RIS-Enabled ISAC in THz Bands

2025-01-21 · Sara Farrag Mobarak, Tingnan Bao, Melike Erol-Kantarci

This paper proposes a novel semi-self sensing hybrid reconfigurable intelligent surface (SS-HRIS) in terahertz (THz) bands, where the RIS is equipped with reflecting elements divided between passive and active elements i…

Deep Reinforcement LearningISAC

Joint Hybrid Beamforming and Artificial Noise Design for Secure Multi-UAV ISAC Networks

2025-09-28 · Runze Dong, Buhong Wang, Cunqian Feng, Jiang Weng 외 arxiv

Integrated sensing and communication (ISAC) emerges as a key enabler for next-generation applications such as smart cities and autonomous systems. Its integration with unmanned aerial vehicles (UAVs) unlocks new potentia…