Joint User Association and Pairing in Multi-UAV-Assisted NOMA Networks: A Decaying-Epsilon Thompson Sampling Framework
Unmanned aerial vehicles (UAVs) are expected to be integrated into future wireless networks to offer services, especially in unreachable or congested areas. To improve the spectral efficiency, non-orthogonal multiple access (NOMA) scheme can be utilised within the UAV communication to allow more users to be covered and associated. The performance of the NOMA-UAVs network is governed by several factors including power allocation, user association and pairing methods. This paper presents an approach that uses multi-armed bandit (MAB) and two-sided matching frameworks to maximize the throughput of multi-UAV-assisted NOMA networks in a decentralized manner. The approach enables the UAVs to propose to the ground users (GUs) without explicit cooperation among the UAVs while the GUs can accept or reject the proposals. To this end, we propose a modified Thompson sampling algorithm that we named decaying epsilon Thompson sampling ( DϵTS ) MAB algorithm that is designed to improve the exploration-exploitation tradeoff in the MAB. The performance of the proposed DϵTS MAB algorithm is evaluated against other existing MAB techniques. Simulation results show that the DϵTS algorithm attains faster convergence and improved performance in terms of smaller regret and increased achievable system throughput. The DϵTS MAB algorithm particularly excels in regards of the convergence rate when the number of available action spaces increases.
Code (0)
등록된 구현이 없습니다.
Tasks
Thompson SamplingSimilar Papers 제목 키워드 기반
Joint User Pairing and Association for Multicell NOMA: A Pointer Network-based Approach
In this paper, we investigate the joint user pairing and association problem for multicell non-orthogonal multiple access (NOMA) systems. We consider a scenario where the user equipments (UEs) are located in a multicell …
Combinatorial OptimizationDeep Reinforcement LearningReinforcement LearningJoint Passive Beamforming and User Association Optimization for IRS-assisted mmWave Systems
In this paper, we investigate an intelligent reflect surface (IRS) assisted multi-user millimeter wave (mmWave) downlink communication system, exploiting IRS to alleviate the blockage effect and enhance the performance o…
Joint User Association, Interference Cancellation and Power Control for Multi-IRS Assisted UAV Communications
Intelligent reflecting surface (IRS)-assisted unmanned aerial vehicle (UAV) communications are expected to alleviate the load of ground base stations in a cost-effective way. Existing studies mainly focus on the deployme…
Q-LearningSchedulingUAV-assisted Joint Mobile Edge Computing and Data Collection via Matching-enabled Deep Reinforcement Learning
Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) and data collection (DC) have been popular research issues. Different from existing works that consider MEC and DC scenarios separately, this paper inves…
Deep Reinforcement LearningEdge-computingPerformance Analysis of RIS-Assisted Large-Scale Wireless Networks Using Stochastic Geometry
In this paper, we investigate the performance of a reconfigurable intelligent surface (RIS) assisted large-scale network by characterizing the coverage probability and the average achievable rate using stochastic geometr…