CLARA: A Constrained Reinforcement Learning Based Resource Allocation Framework for Network Slicing

2021-11-16 · Yongshuai Liu, Jiaxin Ding, Zhi-Li Zhang, Xin Liu

As mobile networks proliferate, we are experiencing a strong diversification of services, which requires greater flexibility from the existing network. Network slicing is proposed as a promising solution for resource utilization in 5G and future networks to address this dire need. In network slicing, dynamic resource orchestration and network slice management are crucial for maximizing resource utilization. Unfortunately, this process is too complex for traditional approaches to be effective due to a lack of accurate models and dynamic hidden structures. We formulate the problem as a Constrained Markov Decision Process (CMDP) without knowing models and hidden structures. Additionally, we propose to solve the problem using CLARA, a Constrained reinforcement LeArning based Resource Allocation algorithm. In particular, we analyze cumulative and instantaneous constraints using adaptive interior-point policy optimization and projection layer, respectively. Evaluations show that CLARA clearly outperforms baselines in resource allocation with service demand guarantees.

📄 PDF Abstract BibTeX arXiv:2111.08397

Code (0)

등록된 구현이 없습니다.

Tasks

Management reinforcement-learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

2023-12-13 · Xin Hao, Phee Lep Yeoh, Changyang She, Branka Vucetic 외

This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our …

Deep Reinforcement Learning Edge-computing Management

DREAM: Decentralized Reinforcement Learning for Exploration and Efficient Energy Management in Multi-Robot Systems

2023-09-29 · Dipam Patel, Phu Pham, Kshitij Tiwari, Aniket Bera

Resource-constrained robots often suffer from energy inefficiencies, underutilized computational abilities due to inadequate task allocation, and a lack of robustness in dynamic environments, all of which strongly affect…

Efficient Exploration energy management Graph Neural Network Management+3

Modelling resource allocation in uncertain system environment through deep reinforcement learning

2021-06-17 · Neel Gandhi, Shakti Mishra

Reinforcement Learning has applications in field of mechatronics, robotics, and other resource-constrained control system. Problem of resource allocation is primarily solved using traditional predefined techniques and mo…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Situational-Constrained Sequential Resources Allocation via Reinforcement Learning

2025-06-17 · Libo Zhang, Yang Chen, Toru Takisaka, Kaiqi Zhao 외

Sequential Resource Allocation with situational constraints presents a significant challenge in real-world applications, where resource demands and priorities are context-dependent. This paper introduces a novel framewor…

Decision Making reinforcement-learning Reinforcement Learning

Secure Resource Allocation via Constrained Deep Reinforcement Learning

2025-01-20 · Jianfei Sun, Qiang Gao, Cong Wu, Yuxian Li 외

The proliferation of Internet of Things (IoT) devices and the advent of 6G technologies have introduced computationally intensive tasks that often surpass the processing capabilities of user devices. Efficient and secure…

Deep Reinforcement Learning Distributed Computing Edge-computing reinforcement-learning+1