Proximal Policy Optimization-based Transmit Beamforming and Phase-shift Design in an IRS-aided ISAC System for the THz Band

2022-03-21 · Xiangnan Liu, Haijun Zhang, Keping Long, Mingyu Zhou, Yonghui Li, H. Vincent Poor

In this paper, an IRS-aided integrated sensing and communications (ISAC) system operating in the terahertz (THz) band is proposed to maximize the system capacity. Transmit beamforming and phase-shift design are transformed into a universal optimization problem with ergodic constraints. Then the joint optimization of transmit beamforming and phase-shift design is achieved by gradient-based, primal-dual proximal policy optimization (PPO) in the multi-user multiple-input single-output (MISO) scenario. Specifically, the actor part generates continuous transmit beamforming and the critic part takes charge of discrete phase shift design. Based on the MISO scenario, we investigate a distributed PPO (DPPO) framework with the concept of multi-threading learning in the multi-user multiple-input multiple-output (MIMO) scenario. Simulation results demonstrate the effectiveness of the primal-dual PPO algorithm and its multi-threading version in terms of transmit beamforming and phase-shift design.

📄 PDF Abstract BibTeX arXiv:2203.10819

Code (0)

등록된 구현이 없습니다.

Tasks

ISAC

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Reconfigurable Intelligent Surfaces Aided mmWave NOMA: Joint Power Allocation,Phase Shifts, and Hybrid Beamforming Optimization

2020-07-11 · Yue Xiu, Jun Zhao, Wei Sun, Marco Di Renzo 외

In this paper, an reconfigurable intelligent surface (RIS)-aided millimeter wave (mmWave) non-orthogonal multiple access (NOMA) system is considered. In particular, we consider an RIS-aided mmWave-NOMA downlink system wi…

Beamforming Design for Multiuser Transmission Through Reconfigurable Intelligent Surface

2020-09-24 · Zhaohui Yang, Wei Xu, Chongwen Huang, Jianfeng Shi 외

This paper investigates the problem of resource allocation for multiuser communication networks with a reconfigurable intelligent surface (RIS)-assisted wireless transmitter. In this network, the sum transmit power of th…

Collaborative Intelligent Reflecting Surface Networks with Multi-Agent Reinforcement Learning

2022-03-26 · Jie Zhang, Jun Li, Yijin Zhang, Qingqing Wu 외

Intelligent reflecting surface (IRS) is envisioned to be widely applied in future wireless networks. In this paper, we investigate a multi-user communication system assisted by cooperative IRS devices with the capability…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

PASS-Enhanced MEC: Joint Optimization of Task Offloading and Uplink PASS Beamforming

2025-10-27 · Zhaoming Hu, Ruikang Zhong, Xidong Mu, Dengao Li 외 arxiv

A pinching-antenna system (PASS)-enhanced mobile edge computing (MEC) architecture is investigated to improve the task offloading efficiency and latency performance in dynamic wireless environments. By leveraging dielect…

Reinforcement Learning

Sum Rate Maximization for Movable Antenna Enhanced Multiuser Covert Communications

2024-10-12 · Haobin Mao, Xiangyu Pi, Lipeng Zhu, Zhenyu Xiao 외

In this letter, we propose to employ movable antenna (MA) to enhance covert communications with noise uncertainty, where the confidential data is transmitted from an MA-aided access point (AP) to multiple users with a wa…

Position