Reinforcement Learning on Computational Resource Allocation of Cloud-based Wireless Networks

2020-10-10 · Beiran Chen, Yi Zhang, George Iosifidis, Mingming Liu

Wireless networks used for Internet of Things (IoT) are expected to largely involve cloud-based computing and processing. Softwarised and centralised signal processing and network switching in the cloud enables flexible network control and management. In a cloud environment, dynamic computational resource allocation is essential to save energy while maintaining the performance of the processes. The stochastic features of the Central Processing Unit (CPU) load variation as well as the possible complex parallelisation situations of the cloud processes makes the dynamic resource allocation an interesting research challenge. This paper models this dynamic computational resource allocation problem into a Markov Decision Process (MDP) and designs a model-based reinforcement-learning agent to optimise the dynamic resource allocation of the CPU usage. Value iteration method is used for the reinforcement-learning agent to pick up the optimal policy during the MDP. To evaluate our performance we analyse two types of processes that can be used in the cloud-based IoT networks with different levels of parallelisation capabilities, i.e., Software-Defined Radio (SDR) and Software-Defined Networking (SDN). The results show that our agent rapidly converges to the optimal policy, stably performs in different parameter settings, outperforms or at least equally performs compared to a baseline algorithm in energy savings for different scenarios.

📄 PDF Abstract BibTeX arXiv:2010.05024

Code (0)

등록된 구현이 없습니다.

Tasks

CPUManagementModel-based Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning Based Resource Allocation for Cloud Native Wireless Network

2023-05-10 · Lin Wang, Jiasheng Wu, Yue Gao, Jingjing Zhang

Cloud native technology has revolutionized 5G beyond and 6G communication networks, offering unprecedented levels of operational automation, flexibility, and adaptability. However, the vast array of cloud native services…

Cloud Computing Deep Reinforcement Learning Edge-computing reinforcement-learning

The state-of-the-art review on resource allocation problem using artificial intelligence methods on various computing paradigms

2022-03-23 · Javad Hassannataj Joloudari, Sanaz Mojrian, Hamid Saadatfar, Issa Nodehi 외

With the increasing growth of information through smart devices, increasing the quality level of human life requires various computational paradigms presentation including the Internet of Things, fog, and cloud. Between …

Cloud Computing Deep Reinforcement Learning Q-Learning reinforcement-learning+1

Meta Federated Reinforcement Learning for Distributed Resource Allocation

2023-07-06 · Zelin Ji, Zhijin Qin, Xiaoming Tao

In cellular networks, resource allocation is usually performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper explores a distributed res…

Federated Learning Meta-Learning reinforcement-learning Reinforcement Learning

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

2020-11-17 · Yueyue Dai, Ke Zhang, Sabita Maharjan, Yan Zhang

5G beyond is an end-edge-cloud orchestrated network that can exploit heterogeneous capabilities of the end devices, edge servers, and the cloud and thus has the potential to enable computation-intensive and delay-sensiti…

Deep Reinforcement Learning

A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks

2019-04-30 · Kazi Ishfaq Ahmed, Ekram Hossain

Optimal resource allocation is a fundamental challenge for dense and heterogeneous wireless networks with massive wireless connections. Because of the non-convex nature of the optimization problem, it is computationally …

Benchmarking Deep Reinforcement Learning Q-Learning Reinforcement Learning