NOMA in UAV-aided cellular offloading: A machine learning approach

2020-10-18 · Ruikang Zhong, Xiao Liu, Yuanwei Liu, Yue Chen

A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs), while non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spectrum efficiency of the wireless network. The optimization problem of joint three-dimensional (3D) trajectory design and power allocation is formulated for maximizing the throughput. In an effort to solve this pertinent dynamic problem, a K-means based clustering algorithm is first adopted for periodically partitioning users. Afterward, a mutual deep Q-network (MDQN) algorithm is proposed to jointly determine the optimal 3D trajectory and power allocation of UAVs. In contrast to the conventional deep Q-network (DQN) algorithm, the MDQN algorithm enables the experience of multi-agent to be input into a shared neural network to shorten the training time with the assistance of state abstraction. Numerical results demonstrate that: 1) the proposed MDQN algorithm has a faster convergence rate than the conventional DQN algorithm in the multi-agent case; 2) The achievable sum rate of the NOMA enhanced UAV network is $23\%$ superior to the case of orthogonal multiple access (OMA); 3) By designing the optimal 3D trajectory of UAVs with the aid of the MDON algorithm, the sum rate of the network enjoys ${142\%}$ and ${56\%}$ gains than that of invoking the circular trajectory and the 2D trajectory, respectively.

📄 PDF Abstract BibTeX arXiv:2011.14776

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningClustering

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Multi-Agent Reinforcement Learning in NOMA-aided UAV Networks for Cellular Offloading

2020-10-18 · Ruikang Zhong, Xiao Liu, Yuanwei Liu, Yue Chen

A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs), while the non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spe…

Clustering Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Offloading of Users in NOMA-HetNet Using Repulsive Point Process

2018-05-29

Ever increasing number of cellular users and their high data requirements, necessitates need for improvement in the present heterogeneous cellular networks (HetNet). Carrier sensing prevents base stations within a certai…

Cache-Aided NOMA Mobile Edge Computing: A Reinforcement Learning Approach

2019-06-20

A novel non-orthogonal multiple access (NOMA) based cache-aided mobile edge computing (MEC) framework is proposed. For the purpose of efficiently allocating communication and computation resources to users' computation t…

Edge-computing Q-Learning reinforcement-learning Reinforcement Learning+1

Circuit design in biology and machine learning. II. Anomaly detection

2024-11-23 · Steven A. Frank

Anomaly detection is a well-established field in machine learning, identifying observations that deviate from typical patterns. The principles of anomaly detection could enhance our understanding of how biological system…

Anomaly Classification Anomaly Detection Decision Making Dimensionality Reduction

IRS Assisted NOMA Aided Mobile Edge Computing with Queue Stability: Heterogeneous Multi-Agent Reinforcement Learning

2022-09-20 · Jiadong Yu, Yang Li, Xiaolan Liu, Bo Sun 외

By employing powerful edge servers for data processing, mobile edge computing (MEC) has been recognized as a promising technology to support emerging computation-intensive applications. Besides, non-orthogonal multiple a…

Edge-computing Multi-agent Reinforcement Learning Reinforcement Learning (RL)